Apr 27 09:59:10 devstack cinder-volume[71932]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 27 09:59:10 devstack cinder-volume[71932]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 27 09:59:10 devstack cinder-volume[71932]: we strongly recommend against using it for new projects. Apr 27 09:59:10 devstack cinder-volume[71932]: If you are already using Eventlet, we recommend migrating to a different Apr 27 09:59:10 devstack cinder-volume[71932]: framework. For more detail see Apr 27 09:59:10 devstack cinder-volume[71932]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 27 09:59:10 devstack cinder-volume[71932]: import eventlet # noqa Apr 27 09:59:12 devstack cinder-volume[71932]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=71932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 27 09:59:12 devstack cinder-volume[71932]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=71932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 27 09:59:12 devstack cinder-volume[71932]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=71932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 27 09:59:12 devstack cinder-volume[71932]: INFO dbcounter [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Registered counter for database cinder Apr 27 09:59:12 devstack cinder-volume[71932]: DEBUG oslo_db.sqlalchemy.engines [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71932) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 09:59:12 devstack cinder-volume[71932]: DEBUG dbcounter [-] [71932] Writer thread running {{(pid=71932) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 27 09:59:12 devstack cinder-volume[71932]: INFO cinder.rpc [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 27 09:59:12 devstack cinder-volume[71932]: INFO cinder.rpc [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 27 09:59:12 devstack cinder-volume[71932]: DEBUG oslo_db.sqlalchemy.engines [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71932) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 09:59:12 devstack cinder-volume[71932]: INFO cinder.volume.manager [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Determined volume DB was empty at startup. Apr 27 09:59:12 devstack cinder-volume[71932]: DEBUG cinder.volume.manager [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=71932) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 27 09:59:12 devstack cinder-volume[71932]: INFO cinder.volume.manager [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 27 09:59:12 devstack cinder-volume[71932]: WARNING stevedore.named [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 27 09:59:12 devstack cinder-volume[71932]: WARNING castellan.key_manager [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 27 09:59:12 devstack cinder-volume[71932]: WARNING cinder.keymgr.conf_key_mgr [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 27 09:59:12 devstack cinder-volume[71932]: DEBUG cinder.volume.drivers.lvm [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=71932) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 27 09:59:12 devstack cinder-volume[71932]: DEBUG oslo_concurrency.processutils [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=71932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_concurrency.processutils [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] CMD "cinder-rtstool verify" returned: 0 in 0.256s {{(pid=71932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_db.sqlalchemy.engines [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71932) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 09:59:13 devstack cinder-volume[71932]: INFO cinder.rpc [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 27 09:59:13 devstack cinder-volume[71932]: INFO cinder.rpc [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 27 09:59:13 devstack cinder-volume[71932]: WARNING stevedore.named [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 27 09:59:13 devstack cinder-volume[71932]: WARNING castellan.key_manager [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 27 09:59:13 devstack cinder-volume[71932]: INFO cinder.volume.manager [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_db.sqlalchemy.engines [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71932) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 09:59:13 devstack cinder-volume[71932]: INFO oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Starting 1 workers Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Started child 72040 {{(pid=71932) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Full set of CONF: {{(pid=71932) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] ******************************************************************************** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Configuration options gathered from: {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] ================================================================================ {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] allow_availability_zone_fallback = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] allow_compression_on_image_upload = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] allowed_direct_url_schemes = [] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] api_rate_limit = True {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] auth_strategy = keystone {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] az_cache_duration = 3600 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_availability_zone = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_host = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_name = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_stats_polling_interval = 60 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backup_api_class = cinder.backup.api.API {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backup_name_template = backup-%s {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backup_use_same_host = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backup_use_temp_snapshot = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] chap_password = **** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] chap_username = {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cinder_internal_tenant_project_id = 05d623aefeae48318d38ecbb7afd7efc {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cinder_internal_tenant_user_id = 2c15003be5ce4762be451ef81437589d {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cloned_volume_same_az = True {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cluster = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] compression_format = gzip {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] compute_api_class = cinder.compute.nova.API {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] config_dir = [] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] config_source = [] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] control_exchange = openstack {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[72040]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] debug = True {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] default_availability_zone = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] default_group_type = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] default_volume_type = lvmdriver-1 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] disk_geometry = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] driver_client_cert = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] driver_client_cert_key = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] driver_data_namespace = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] driver_ssl_cert_path = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] driver_ssl_cert_verify = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] driver_use_ssl = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] enable_force_upload = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] enable_new_services = True {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] enable_unsupported_driver = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] enabled_backends = ['lvmdriver-1'] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] enforce_multipath_for_image_xfer = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] filter_function = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] glance_api_insecure = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] glance_api_servers = ['http://192.168.122.125/image'] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] glance_api_ssl_compression = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] glance_ca_certificates_file = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] glance_catalog_info = image:glance:publicURL {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] glance_certfile = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] glance_keyfile = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] glance_num_retries = 3 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] glance_request_timeout = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] goodness_function = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] graceful_shutdown_timeout = 5 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] group_api_class = cinder.group.api.API {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] host = devstack {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] image_compress_on_upload = True {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] image_conversion_address_space_limit = 1 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] image_conversion_cpu_limit = 60 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] image_conversion_disable = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] image_upload_use_cinder_backend = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] image_upload_use_internal_tenant = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] image_volume_cache_enabled = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] image_volume_cache_max_count = 0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] image_volume_cache_max_size_gb = 0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] init_host_max_objects_retrieval = 0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] instance_format = [instance: %(uuid)s] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] iscsi_target_flags = {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] iscsi_write_cache = on {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] iser_helper = tgtadm {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] iser_ip_address = 192.168.122.125 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] iser_port = 3260 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] log_color = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] log_config_append = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] log_dir = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] log_file = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] log_options = True {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] log_rotate_interval = 1 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] log_rotate_interval_type = days {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] log_rotation_type = none {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] max_age = 0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] max_logfile_count = 30 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] max_logfile_size_mb = 200 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] max_over_subscription_ratio = 20.0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] message_reap_interval = 86400 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] message_ttl = 2592000 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] migration_create_volume_timeout_secs = 300 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] monkey_patch = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] monkey_patch_modules = [] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] my_ip = 192.168.122.125 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] no_snapshot_gb_quota = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] num_iser_scan_tries = 3 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] num_shell_tries = 3 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] num_volume_device_scan_tries = 3 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] nvmeof_conn_info_version = 1 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] nvmet_ns_id = 10 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] nvmet_port_id = 1 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] osapi_max_limit = 1000 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] osapi_volume_ext_list = [] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] osapi_volume_listen = 0.0.0.0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] osapi_volume_listen_port = 8776 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] osapi_volume_use_ssl = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] osapi_volume_workers = 2 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] per_volume_size_limit = -1 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] periodic_fuzzy_delay = 60 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] periodic_interval = 60 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] project_id_regex = [0-9a-f\-]+ {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] public_endpoint = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] publish_errors = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] quota_backup_gigabytes = 1000 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] quota_backups = 10 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] quota_gigabytes = 1000 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] quota_groups = 10 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] quota_snapshots = 10 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] quota_volumes = 10 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] rate_limit_burst = 0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] rate_limit_except_level = CRITICAL {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] rate_limit_interval = 0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] reinit_driver_count = 3 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] replication_device = **** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] report_discard_supported = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] report_interval = 120 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] reservation_clean_interval = 86400 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] reservation_expire = 86400 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] reserved_image_namespaces = [] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] reserved_percentage = 0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] rpc_response_timeout = 120 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] run_external_periodic_tasks = True {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] scst_target_driver = iscsi {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] scst_target_iqn_name = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] service_down_time = 720 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] shell_completion = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] snapshot_name_template = snapshot-%s {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] snapshot_same_host = True {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] split_loggers = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] state_path = /opt/stack/data/cinder {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] storage_availability_zone = nova {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] storage_protocol = iSCSI {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] syslog_log_facility = LOG_USER {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] target_helper = lioadm {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] target_ip_address = 192.168.122.125 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] target_port = 3260 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] target_protocol = iscsi {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] target_secondary_ip_addresses = [] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] trace_flags = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] transfer_api_class = cinder.transfer.api.API {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] transport_url = **** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] until_refresh = 0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] use_chap_auth = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] use_default_quota_class = True {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] use_journal = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] use_json = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] use_multipath_for_image_xfer = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] use_stderr = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] use_syslog = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] verify_glance_signatures = enabled {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] volume_api_class = cinder.volume.api.API {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] volume_backend_name = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] volume_clear = zero {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] volume_clear_ionice = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[72040]: INFO cinder.volume.manager [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] volume_clear_size = 0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] volume_copy_bps_limit = 0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] volume_dd_blocksize = 1M {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] volume_name_template = volume-%s {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] volume_service_inithost_offload = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] volume_usage_audit_period = month {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] zoning_mode = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_concurrency.disable_process_locking = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.admin_password = **** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.admin_tenant_name = admin {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.admin_token = **** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.admin_user = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.auth_admin_prefix = {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.auth_port = 35357 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.auth_protocol = https {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.auth_section = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.auth_type = password {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.auth_uri = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.auth_version = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.cache = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.certfile = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.delay_auth_decision = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.http_connect_timeout = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.identity_uri = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.include_service_catalog = True {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.insecure = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.interface = public {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.keyfile = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.memcache_password = {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.memcache_username = {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.region_name = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.service_token_roles_required = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.service_type = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.token_cache_time = 300 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.125/identity {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.backend = dogpile.cache.null {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.backend_argument = **** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.backend_expiration_time = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.config_prefix = cache.oslo {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.debug_cache_backend = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.enable_retry_client = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.enable_socket_keepalive = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.enabled = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.enforce_fips_mode = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.expiration_time = 600 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.hashclient_retry_attempts = 2 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.memcache_dead_retry = 300 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.memcache_pool_maxsize = 10 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.memcache_sasl_enabled = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.password = **** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.proxies = [] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.redis_db = 0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.redis_sentinel_service_name = mymaster {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.redis_server = localhost:6379 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.retry_attempts = 2 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.retry_delay = 0.0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.socket_keepalive_count = 1 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.socket_keepalive_idle = 1 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.socket_keepalive_interval = 1 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.socket_timeout = 1.0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.tls_allowed_ciphers = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.tls_cafile = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.tls_certfile = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.tls_enabled = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.tls_keyfile = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cache.username = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] coordination.backend_url = **** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] database.asyncio_connection = **** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] database.asyncio_slave_connection = **** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] database.backend = sqlalchemy {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] database.connection = **** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] database.connection_debug = 0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] database.connection_parameters = {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] database.connection_recycle_time = 3600 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] database.connection_trace = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] database.db_inc_retry_interval = True {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] database.db_max_retries = 20 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] database.db_max_retry_interval = 10 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] database.db_retry_interval = 1 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] database.max_overflow = 50 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] database.max_pool_size = 5 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] database.max_retries = 10 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] database.mysql_wsrep_sync_wait = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] database.pool_timeout = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] database.retry_interval = 10 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] database.slave_connection = **** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] database.sqlite_synchronous = True {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] database.synchronous_reader = True {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] database.use_db_reconnect = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] profiler.connection_string = messaging:// {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] profiler.enabled = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] profiler.es_doc_type = notification {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] profiler.es_scroll_size = 10000 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] profiler.es_scroll_time = 2m {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] profiler.filter_error_trace = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] profiler.hmac_keys = **** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] profiler.sentinel_service_name = mymaster {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] profiler.socket_timeout = 0.1 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] profiler.trace_requests = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] profiler.trace_sqlalchemy = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] profiler_jaeger.process_tags = {} {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:13 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] profiler_jaeger.service_name_prefix = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] profiler_otlp.service_name_prefix = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_policy.enforce_new_defaults = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: WARNING oslo_config.cfg [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_policy.enforce_scope = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_policy.policy_default_rule = default {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_policy.policy_file = policy.yaml {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_policy.remote_timeout = 60.0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] privsep_osbrick.group = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] privsep_osbrick.helper_command = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] privsep_osbrick.user = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cinder_sys_admin.group = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cinder_sys_admin.helper_command = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] cinder_sys_admin.user = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] service_user.auth_section = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] service_user.auth_type = password {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] service_user.cafile = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] service_user.certfile = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] service_user.collect_timing = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] service_user.insecure = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] service_user.keyfile = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] service_user.send_service_user_token = True {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] service_user.split_loggers = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] service_user.timeout = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] glance.auth_section = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] glance.auth_type = password {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] glance.certfile = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] glance.collect_timing = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] glance.insecure = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] glance.keyfile = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] glance.region_name = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] glance.split_loggers = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] glance.timeout = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.backend_availability_zone = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.chap_password = **** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.chap_username = {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.disk_geometry = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.driver_client_cert = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.driver_client_cert_key = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.driver_data_namespace = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.driver_use_ssl = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.enable_unsupported_driver = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.extra_capabilities = {} {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.filter_function = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.goodness_function = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.iscsi_target_flags = {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.iscsi_write_cache = on {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.iser_helper = tgtadm {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.iser_ip_address = 192.168.122.125 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.iser_port = 3260 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.lvm_mirrors = 0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.lvm_share_target = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.lvm_type = auto {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.num_shell_tries = 3 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.nvmet_port_id = 1 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.replication_device = **** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.report_discard_supported = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.reserved_percentage = 0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.scst_target_driver = iscsi {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.scst_target_iqn_name = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.storage_protocol = iSCSI {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.target_helper = tgtadm {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.target_ip_address = 192.168.122.125 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.target_port = 3260 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.target_protocol = iscsi {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.trace_flags = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.unique_fqdn_network = True {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.use_chap_auth = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.volume_backend_name = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.volume_clear = zero {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.volume_clear_ionice = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.volume_clear_size = 0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.volume_group = cinder-volumes {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_reports.file_event_handler = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_reports.log_dir = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.backend_availability_zone = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.backend_host = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.chap_password = **** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.chap_username = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.chiscsi_conf = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.disk_geometry = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.driver_client_cert = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.driver_client_cert_key = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.driver_data_namespace = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.driver_use_ssl = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack sudo[72050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.extra_capabilities = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.filter_function = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.goodness_function = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack sudo[72050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.iscsi_target_flags = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.iscsi_write_cache = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.iser_helper = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.iser_ip_address = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.iser_port = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.iser_target_prefix = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.lvm_conf_file = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.lvm_mirrors = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.lvm_share_target = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.lvm_type = auto {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.num_shell_tries = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.nvmet_ns_id = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.nvmet_port_id = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.replication_device = **** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.report_discard_supported = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.reserved_percentage = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.scst_target_driver = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.storage_protocol = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.target_helper = lioadm {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.target_ip_address = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.target_port = 3260 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.target_protocol = iscsi {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.trace_flags = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.unique_fqdn_network = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.use_chap_auth = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.volume_clear = zero {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.volume_clear_ionice = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.volume_clear_size = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] lvmdriver-1.volumes_dir = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.ssl = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.ssl_version = {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_notifications.driver = [] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_notifications.retry = -1 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] oslo_messaging_notifications.transport_url = **** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] key_manager.fixed_key = **** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican.barbican_api_version = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican.barbican_endpoint = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican.barbican_endpoint_type = public {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican.barbican_region_name = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican.cafile = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican.certfile = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican.collect_timing = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican.insecure = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican.keyfile = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican.number_of_retries = 60 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican.retry_delay = 1 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican.send_service_user_token = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican.split_loggers = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican.timeout = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican.verify_ssl = True {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican.verify_ssl_path = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican_service_user.auth_section = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican_service_user.auth_type = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican_service_user.cafile = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican_service_user.certfile = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican_service_user.collect_timing = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican_service_user.insecure = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican_service_user.keyfile = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican_service_user.split_loggers = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] barbican_service_user.timeout = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] vault.approle_role_id = **** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] vault.approle_secret_id = **** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] vault.kv_mountpoint = secret {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] vault.kv_path = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] vault.kv_version = 2 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] vault.namespace = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] vault.root_token_id = **** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] vault.ssl_ca_crt_file = None {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] vault.timeout = 60.0 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] vault.use_ssl = False {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 09:59:13 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] ******************************************************************************** {{(pid=71932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 27 09:59:14 devstack sudo[72050]: pam_unix(sudo:session): session closed for user root Apr 27 09:59:14 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:14 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:14 devstack sudo[72291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 27 09:59:14 devstack sudo[72291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 09:59:14 devstack sudo[72291]: pam_unix(sudo:session): session closed for user root Apr 27 09:59:14 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.542s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:14 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 09:59:14 devstack cinder-volume[72040]: INFO cinder.brick.local_dev.lvm [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 27 09:59:14 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:14 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:14 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:14 devstack sudo[72523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 27 09:59:14 devstack sudo[72523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 09:59:15 devstack sudo[72523]: pam_unix(sudo:session): session closed for user root Apr 27 09:59:15 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.729s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:15 devstack cinder-volume[72040]: DEBUG cinder.brick.local_dev.lvm [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72040) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 27 09:59:15 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:15 devstack sudo[72603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 27 09:59:15 devstack sudo[72603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 09:59:16 devstack sudo[72603]: pam_unix(sudo:session): session closed for user root Apr 27 09:59:16 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.982s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:16 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:16 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:16 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:16 devstack sudo[72738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 27 09:59:16 devstack sudo[72738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 09:59:16 devstack sudo[72738]: pam_unix(sudo:session): session closed for user root Apr 27 09:59:16 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.492s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:16 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:16 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:16 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:16 devstack sudo[72742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 27 09:59:16 devstack sudo[72742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 09:59:17 devstack sudo[72742]: pam_unix(sudo:session): session closed for user root Apr 27 09:59:17 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.489s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:17 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:17 devstack sudo[72747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 27 09:59:17 devstack sudo[72747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 09:59:17 devstack sudo[72747]: pam_unix(sudo:session): session closed for user root Apr 27 09:59:17 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.512s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:17 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:17 devstack sudo[72753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 27 09:59:17 devstack sudo[72753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 09:59:18 devstack sudo[72753]: pam_unix(sudo:session): session closed for user root Apr 27 09:59:18 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:18 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:18 devstack sudo[72758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 09:59:18 devstack sudo[72758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 09:59:18 devstack sudo[72758]: pam_unix(sudo:session): session closed for user root Apr 27 09:59:18 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:18 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:18 devstack sudo[72761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 27 09:59:18 devstack sudo[72761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 09:59:19 devstack sudo[72761]: pam_unix(sudo:session): session closed for user root Apr 27 09:59:19 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.659s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:19 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:19 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:19 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:19 devstack sudo[72825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 27 09:59:19 devstack sudo[72825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 09:59:20 devstack sudo[72825]: pam_unix(sudo:session): session closed for user root Apr 27 09:59:20 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.485s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:20 devstack cinder-volume[72040]: INFO cinder.volume.drivers.lvm [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 27 09:59:20 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:20 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:20 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:20 devstack sudo[72886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 27 09:59:20 devstack sudo[72886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 09:59:20 devstack sudo[72886]: pam_unix(sudo:session): session closed for user root Apr 27 09:59:20 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.505s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:20 devstack cinder-volume[72040]: DEBUG cinder.volume.drivers.lvm [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Updating volume stats {{(pid=72040) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 27 09:59:20 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:20 devstack sudo[72959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 27 09:59:20 devstack sudo[72959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 09:59:21 devstack sudo[72959]: pam_unix(sudo:session): session closed for user root Apr 27 09:59:21 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.521s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:21 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:21 devstack sudo[73031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 09:59:21 devstack sudo[73031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 09:59:21 devstack sudo[73031]: pam_unix(sudo:session): session closed for user root Apr 27 09:59:21 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.514s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:21 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:21 devstack sudo[73034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 27 09:59:21 devstack sudo[73034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 09:59:22 devstack sudo[73034]: pam_unix(sudo:session): session closed for user root Apr 27 09:59:22 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.466s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:22 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:22 devstack sudo[73040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 09:59:22 devstack sudo[73040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 09:59:22 devstack sudo[73040]: pam_unix(sudo:session): session closed for user root Apr 27 09:59:22 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:22 devstack cinder-volume[72040]: INFO cinder.volume.driver [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Driver hasn't implemented _init_vendor_properties() Apr 27 09:59:22 devstack cinder-volume[72040]: DEBUG cinder.volume.driver [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72040) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 27 09:59:22 devstack cinder-volume[72040]: DEBUG oslo_db.sqlalchemy.engines [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72040) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 09:59:22 devstack cinder-volume[72040]: DEBUG dbcounter [-] [72040] Writer thread running {{(pid=72040) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 27 09:59:22 devstack cinder-volume[72040]: DEBUG cinder.db.sqlalchemy.api [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Building query based on filter {{(pid=72040) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 27 09:59:22 devstack cinder-volume[72040]: DEBUG cinder.image.image_utils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72040) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 27 09:59:22 devstack cinder-volume[72040]: INFO cinder.keymgr.migration [None req-eacdde2d-6d86-4e3d-a972-f30b31a61edf None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 27 09:59:22 devstack cinder-volume[72040]: DEBUG cinder.volume.drivers.lvm [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Updating volume stats {{(pid=72040) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 27 09:59:22 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:22 devstack sudo[73045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 27 09:59:22 devstack sudo[73045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 09:59:23 devstack sudo[73045]: pam_unix(sudo:session): session closed for user root Apr 27 09:59:23 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.534s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:23 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:23 devstack sudo[73048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 09:59:23 devstack sudo[73048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 09:59:23 devstack cinder-volume[71932]: DEBUG dbcounter [-] [71932] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=71932) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 09:59:23 devstack sudo[73048]: pam_unix(sudo:session): session closed for user root Apr 27 09:59:23 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.520s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:23 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:23 devstack sudo[73054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 27 09:59:23 devstack sudo[73054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 09:59:24 devstack sudo[73054]: pam_unix(sudo:session): session closed for user root Apr 27 09:59:24 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.497s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:24 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:24 devstack sudo[73061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 09:59:24 devstack sudo[73061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 09:59:24 devstack sudo[73061]: pam_unix(sudo:session): session closed for user root Apr 27 09:59:24 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.516s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:24 devstack cinder-volume[72040]: DEBUG cinder.manager [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Notifying Schedulers of capabilities ... {{(pid=72040) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 09:59:24 devstack cinder-volume[72040]: INFO cinder.volume.manager [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Driver initialization completed successfully. Apr 27 09:59:24 devstack cinder-volume[72040]: INFO cinder.manager [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Initiating service 2 cleanup Apr 27 09:59:24 devstack cinder-volume[72040]: INFO cinder.manager [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Service 2 cleanup completed. Apr 27 09:59:24 devstack cinder-volume[72040]: DEBUG cinder.service [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Creating RPC server for service cinder-volume {{(pid=72040) start /opt/stack/cinder/cinder/service.py:231}} Apr 27 09:59:24 devstack cinder-volume[72040]: DEBUG cinder.service [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72040) start /opt/stack/cinder/cinder/service.py:237}} Apr 27 09:59:24 devstack cinder-volume[72040]: INFO cinder.volume.manager [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 27 09:59:24 devstack cinder-volume[72040]: DEBUG cinder.volume.drivers.lvm [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Updating volume stats {{(pid=72040) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 27 09:59:24 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:24 devstack sudo[73065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 27 09:59:24 devstack sudo[73065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 09:59:25 devstack sudo[73065]: pam_unix(sudo:session): session closed for user root Apr 27 09:59:25 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.497s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:25 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:25 devstack sudo[73068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 09:59:25 devstack sudo[73068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 09:59:25 devstack sudo[73068]: pam_unix(sudo:session): session closed for user root Apr 27 09:59:25 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.480s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:25 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:25 devstack sudo[73125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 27 09:59:25 devstack sudo[73125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 09:59:26 devstack sudo[73125]: pam_unix(sudo:session): session closed for user root Apr 27 09:59:26 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.438s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:26 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 09:59:26 devstack sudo[73320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 09:59:26 devstack sudo[73320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 09:59:26 devstack sudo[73320]: pam_unix(sudo:session): session closed for user root Apr 27 09:59:26 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 09:59:26 devstack cinder-volume[72040]: INFO cinder.volume.manager [None req-cab15b78-5a32-42e1-9c6e-2a4c48d81b0d None None] Driver post RPC initialization completed successfully. Apr 27 09:59:34 devstack cinder-volume[72040]: DEBUG dbcounter [-] [72040] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72040) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 09:59:36 devstack cinder-volume[72040]: DEBUG dbcounter [-] [72040] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=72040) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:00:33 devstack cinder-volume[72040]: DEBUG oslo_service.periodic_task [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72040) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 10:00:33 devstack cinder-volume[72040]: DEBUG cinder.volume.drivers.lvm [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] Updating volume stats {{(pid=72040) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 27 10:00:33 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:00:33 devstack sudo[77855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 27 10:00:33 devstack sudo[77855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:00:34 devstack sudo[77855]: pam_unix(sudo:session): session closed for user root Apr 27 10:00:34 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:00:34 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:00:34 devstack sudo[77859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 10:00:34 devstack sudo[77859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:00:34 devstack sudo[77859]: pam_unix(sudo:session): session closed for user root Apr 27 10:00:34 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:00:34 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:00:34 devstack sudo[77862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 27 10:00:34 devstack sudo[77862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:00:35 devstack sudo[77862]: pam_unix(sudo:session): session closed for user root Apr 27 10:00:35 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.467s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:00:35 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:00:35 devstack sudo[77865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 10:00:35 devstack sudo[77865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:00:35 devstack sudo[77865]: pam_unix(sudo:session): session closed for user root Apr 27 10:00:35 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:00:35 devstack cinder-volume[72040]: DEBUG cinder.manager [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] Notifying Schedulers of capabilities ... {{(pid=72040) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:01:33 devstack cinder-volume[72040]: DEBUG oslo_service.periodic_task [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72040) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 10:01:33 devstack cinder-volume[72040]: DEBUG cinder.volume.drivers.lvm [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] Updating volume stats {{(pid=72040) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 27 10:01:33 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:01:33 devstack sudo[79123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 27 10:01:33 devstack sudo[79123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:01:34 devstack sudo[79123]: pam_unix(sudo:session): session closed for user root Apr 27 10:01:34 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.443s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:01:34 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:01:34 devstack sudo[79143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 10:01:34 devstack sudo[79143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:01:34 devstack sudo[79143]: pam_unix(sudo:session): session closed for user root Apr 27 10:01:34 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:01:34 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:01:34 devstack sudo[79170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 27 10:01:34 devstack sudo[79170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:01:35 devstack sudo[79170]: pam_unix(sudo:session): session closed for user root Apr 27 10:01:35 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.474s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:01:35 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:01:35 devstack sudo[79173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 10:01:35 devstack sudo[79173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:01:35 devstack sudo[79173]: pam_unix(sudo:session): session closed for user root Apr 27 10:01:35 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.483s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:01:35 devstack cinder-volume[72040]: DEBUG cinder.manager [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] Notifying Schedulers of capabilities ... {{(pid=72040) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:01:36 devstack cinder-volume[72040]: DEBUG dbcounter [-] [72040] Writing DB stats cinder:SELECT=1 {{(pid=72040) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:01:36 devstack cinder-volume[72040]: DEBUG dbcounter [-] [72040] Writing DB stats cinder:UPDATE=1 {{(pid=72040) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:02:33 devstack cinder-volume[72040]: DEBUG oslo_service.periodic_task [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72040) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 10:02:33 devstack cinder-volume[72040]: DEBUG cinder.volume.drivers.lvm [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] Updating volume stats {{(pid=72040) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 27 10:02:33 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:02:33 devstack sudo[80550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 27 10:02:33 devstack sudo[80550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:02:34 devstack sudo[80550]: pam_unix(sudo:session): session closed for user root Apr 27 10:02:34 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:02:34 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:02:34 devstack sudo[80554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 10:02:34 devstack sudo[80554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:02:34 devstack sudo[80554]: pam_unix(sudo:session): session closed for user root Apr 27 10:02:34 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.482s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:02:34 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:02:34 devstack sudo[80568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 27 10:02:34 devstack sudo[80568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:02:35 devstack sudo[80568]: pam_unix(sudo:session): session closed for user root Apr 27 10:02:35 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.467s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:02:35 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:02:35 devstack sudo[80571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 10:02:35 devstack sudo[80571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:02:35 devstack sudo[80571]: pam_unix(sudo:session): session closed for user root Apr 27 10:02:35 devstack cinder-volume[72040]: DEBUG oslo_concurrency.processutils [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=72040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:02:35 devstack cinder-volume[72040]: DEBUG cinder.manager [None req-7ca7f023-0f5f-4888-8d3d-5e786ff504a5 None None] Notifying Schedulers of capabilities ... {{(pid=72040) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:02:46 devstack cinder-volume[71932]: INFO oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Caught SIGTERM, stopping children Apr 27 10:02:46 devstack cinder-volume[71932]: DEBUG oslo_concurrency.lockutils [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Acquiring lock "singleton_lock" {{(pid=71932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 27 10:02:46 devstack cinder-volume[71932]: DEBUG oslo_concurrency.lockutils [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Acquired lock "singleton_lock" {{(pid=71932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 27 10:02:46 devstack cinder-volume[71932]: DEBUG oslo_concurrency.lockutils [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Releasing lock "singleton_lock" {{(pid=71932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 27 10:02:46 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Stop services. {{(pid=71932) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 27 10:02:46 devstack cinder-volume[71932]: DEBUG oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Killing children. {{(pid=71932) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 27 10:02:46 devstack cinder-volume[71932]: INFO oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Waiting on 1 children to exit Apr 27 10:02:49 devstack cinder-volume[72040]: DEBUG oslo_concurrency.lockutils [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Acquiring lock "singleton_lock" {{(pid=72040) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 27 10:02:49 devstack cinder-volume[72040]: DEBUG oslo_concurrency.lockutils [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Acquired lock "singleton_lock" {{(pid=72040) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 27 10:02:49 devstack cinder-volume[72040]: DEBUG oslo_concurrency.lockutils [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Releasing lock "singleton_lock" {{(pid=72040) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 27 10:02:49 devstack cinder-volume[72040]: WARNING amqp [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 27 10:02:49 devstack cinder-volume[72040]: WARNING amqp [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 27 10:02:49 devstack cinder-volume[71932]: INFO oslo_service.backend._eventlet.service [None req-70472786-3540-4039-b835-c7e388ba6cfb None None] Child 72040 exited with status 0 Apr 27 10:02:50 devstack cinder-volume[80973]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 27 10:02:50 devstack cinder-volume[80973]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 27 10:02:50 devstack cinder-volume[80973]: we strongly recommend against using it for new projects. Apr 27 10:02:50 devstack cinder-volume[80973]: If you are already using Eventlet, we recommend migrating to a different Apr 27 10:02:50 devstack cinder-volume[80973]: framework. For more detail see Apr 27 10:02:50 devstack cinder-volume[80973]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 27 10:02:50 devstack cinder-volume[80973]: import eventlet # noqa Apr 27 10:02:52 devstack cinder-volume[80973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=80973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 27 10:02:52 devstack cinder-volume[80973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=80973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 27 10:02:52 devstack cinder-volume[80973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=80973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 27 10:02:52 devstack cinder-volume[80973]: INFO dbcounter [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Registered counter for database cinder Apr 27 10:02:52 devstack cinder-volume[80973]: DEBUG oslo_db.sqlalchemy.engines [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80973) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 10:02:52 devstack cinder-volume[80973]: DEBUG dbcounter [-] [80973] Writer thread running {{(pid=80973) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 27 10:02:52 devstack cinder-volume[80973]: INFO cinder.rpc [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 27 10:02:52 devstack cinder-volume[80973]: INFO cinder.rpc [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 27 10:02:52 devstack cinder-volume[80973]: DEBUG oslo_db.sqlalchemy.engines [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80973) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 10:02:53 devstack cinder-volume[80973]: INFO cinder.volume.manager [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Determined volume DB was empty at startup. Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG cinder.volume.manager [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=80973) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 27 10:02:53 devstack cinder-volume[80973]: INFO cinder.volume.manager [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 27 10:02:53 devstack cinder-volume[80973]: WARNING stevedore.named [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 27 10:02:53 devstack cinder-volume[80973]: WARNING castellan.key_manager [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 27 10:02:53 devstack cinder-volume[80973]: WARNING cinder.keymgr.conf_key_mgr [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 27 10:02:53 devstack cinder-volume[80973]: INFO cinder.volume.manager [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_db.sqlalchemy.engines [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80973) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 10:02:53 devstack cinder-volume[80973]: INFO oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Starting 1 workers Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Started child 81122 {{(pid=80973) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Full set of CONF: {{(pid=80973) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] ******************************************************************************** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Configuration options gathered from: {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] ================================================================================ {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] allow_availability_zone_fallback = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] allow_compression_on_image_upload = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] allowed_direct_url_schemes = [] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] api_rate_limit = True {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] auth_strategy = keystone {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_availability_zone = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_host = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_name = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_stats_polling_interval = 60 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backup_api_class = cinder.backup.api.API {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backup_name_template = backup-%s {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backup_use_same_host = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backup_use_temp_snapshot = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] chap_password = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] chap_username = {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[81122]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cinder_internal_tenant_project_id = 05d623aefeae48318d38ecbb7afd7efc {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cinder_internal_tenant_user_id = 2c15003be5ce4762be451ef81437589d {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cluster = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] compression_format = gzip {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] compute_api_class = cinder.compute.nova.API {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] config_dir = [] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] config_source = [] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] control_exchange = openstack {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] debug = True {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] default_availability_zone = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] default_group_type = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] default_volume_type = QuobyteHD {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] disk_geometry = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] driver_client_cert = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] driver_client_cert_key = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] driver_data_namespace = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] driver_ssl_cert_path = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] driver_ssl_cert_verify = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] driver_use_ssl = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] enable_new_services = True {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] enable_unsupported_driver = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] enabled_backends = ['QuobyteHD'] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] enforce_multipath_for_image_xfer = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] filter_function = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] glance_api_insecure = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] glance_api_servers = ['http://192.168.122.125/image'] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] glance_api_ssl_compression = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] glance_ca_certificates_file = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] glance_catalog_info = image:glance:publicURL {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] glance_certfile = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] glance_keyfile = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] glance_num_retries = 3 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] glance_request_timeout = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] goodness_function = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] graceful_shutdown_timeout = 5 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] group_api_class = cinder.group.api.API {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] host = devstack {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] image_compress_on_upload = True {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] image_conversion_address_space_limit = 1 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] image_conversion_cpu_limit = 60 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] image_conversion_disable = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] image_upload_use_cinder_backend = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] image_upload_use_internal_tenant = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] image_volume_cache_enabled = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] image_volume_cache_max_count = 0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] image_volume_cache_max_size_gb = 0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] init_host_max_objects_retrieval = 0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] instance_format = [instance: %(uuid)s] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] iscsi_target_flags = {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] iscsi_write_cache = on {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] iser_helper = tgtadm {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] iser_ip_address = 192.168.122.125 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] iser_port = 3260 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] log_color = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] log_config_append = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] log_dir = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] log_file = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] log_options = True {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] log_rotate_interval = 1 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] log_rotate_interval_type = days {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] log_rotation_type = none {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] max_age = 0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] max_logfile_count = 30 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] max_logfile_size_mb = 200 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] max_over_subscription_ratio = 20.0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] message_reap_interval = 86400 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] message_ttl = 2592000 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] migration_create_volume_timeout_secs = 300 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] monkey_patch = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] monkey_patch_modules = [] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] my_ip = 192.168.122.125 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] no_snapshot_gb_quota = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] num_iser_scan_tries = 3 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] num_shell_tries = 3 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] num_volume_device_scan_tries = 3 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] nvmeof_conn_info_version = 1 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[81122]: INFO cinder.volume.manager [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] nvmet_ns_id = 10 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] nvmet_port_id = 1 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] osapi_max_limit = 1000 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] osapi_volume_ext_list = [] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] osapi_volume_listen = 0.0.0.0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] osapi_volume_listen_port = 8776 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] osapi_volume_use_ssl = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] osapi_volume_workers = 2 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] per_volume_size_limit = -1 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] periodic_fuzzy_delay = 60 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] periodic_interval = 60 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] project_id_regex = [0-9a-f\-]+ {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] public_endpoint = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] publish_errors = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] quota_backup_gigabytes = 1000 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] quota_backups = 10 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] quota_gigabytes = 1000 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] quota_groups = 10 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] quota_snapshots = 10 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] quota_volumes = 10 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] rate_limit_burst = 0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] rate_limit_except_level = CRITICAL {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] rate_limit_interval = 0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[81122]: DEBUG cinder.volume.drivers.remotefs [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81122) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] reinit_driver_count = 3 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] replication_device = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] report_discard_supported = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] report_interval = 120 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] reservation_clean_interval = 86400 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] reservation_expire = 86400 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] reserved_image_namespaces = [] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] reserved_percentage = 0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] rpc_response_timeout = 120 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] run_external_periodic_tasks = True {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] scst_target_driver = iscsi {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] scst_target_iqn_name = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] service_down_time = 720 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] shell_completion = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] snapshot_name_template = snapshot-%s {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] split_loggers = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] state_path = /opt/stack/data/cinder {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] storage_availability_zone = nova {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] storage_protocol = iSCSI {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] syslog_log_facility = LOG_USER {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] target_helper = lioadm {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] target_ip_address = 192.168.122.125 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] target_port = 3260 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] target_protocol = iscsi {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] target_secondary_ip_addresses = [] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] trace_flags = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] transfer_api_class = cinder.transfer.api.API {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] transport_url = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] until_refresh = 0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] use_chap_auth = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] use_default_quota_class = True {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] use_journal = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] use_json = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] use_multipath_for_image_xfer = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] use_stderr = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] use_syslog = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] verify_glance_signatures = enabled {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] volume_api_class = cinder.volume.api.API {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] volume_backend_name = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] volume_clear = zero {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] volume_clear_ionice = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] volume_clear_size = 0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] volume_copy_bps_limit = 0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] volume_dd_blocksize = 1M {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] volume_name_template = volume-%s {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] volume_service_inithost_offload = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] volume_usage_audit_period = month {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] zoning_mode = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_concurrency.disable_process_locking = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.admin_password = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.admin_token = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.admin_user = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.auth_admin_prefix = {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.auth_port = 35357 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.auth_protocol = https {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.auth_section = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[81122]: DEBUG cinder.volume.drivers.quobyte [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81122) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 27 10:02:53 devstack cinder-volume[81122]: WARNING cinder.volume.drivers.quobyte [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 27 10:02:53 devstack cinder-volume[81122]: WARNING cinder.volume.drivers.quobyte [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.auth_type = password {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[81122]: DEBUG oslo_concurrency.processutils [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Running cmd (subprocess): mount.quobyte {{(pid=81122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.auth_uri = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.auth_version = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.cache = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.certfile = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.delay_auth_decision = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.http_connect_timeout = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.identity_uri = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.include_service_catalog = True {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.insecure = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.interface = public {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.keyfile = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.memcache_password = {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.memcache_username = {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.region_name = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.service_token_roles_required = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.service_type = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.token_cache_time = 300 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.125/identity {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.backend = dogpile.cache.null {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.backend_argument = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.backend_expiration_time = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.config_prefix = cache.oslo {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.debug_cache_backend = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.enable_retry_client = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.enable_socket_keepalive = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.enabled = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.enforce_fips_mode = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.expiration_time = 600 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.hashclient_retry_attempts = 2 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.memcache_dead_retry = 300 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.memcache_pool_maxsize = 10 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.memcache_sasl_enabled = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.password = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.proxies = [] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.redis_db = 0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.redis_sentinel_service_name = mymaster {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.redis_server = localhost:6379 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.retry_attempts = 2 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.retry_delay = 0.0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.socket_keepalive_count = 1 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.socket_keepalive_idle = 1 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.socket_keepalive_interval = 1 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.socket_timeout = 1.0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.tls_allowed_ciphers = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.tls_cafile = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.tls_certfile = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.tls_enabled = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.tls_keyfile = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cache.username = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] coordination.backend_url = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] database.asyncio_connection = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] database.asyncio_slave_connection = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] database.backend = sqlalchemy {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] database.connection = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] database.connection_debug = 0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] database.connection_parameters = {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] database.connection_recycle_time = 3600 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] database.connection_trace = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] database.db_inc_retry_interval = True {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] database.db_max_retries = 20 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] database.db_max_retry_interval = 10 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack quobyte-client[81126]: Reading configuration file: /etc/quobyte/client.cfg Apr 27 10:02:53 devstack quobyte-client[81126]: Invalid parameters found, error: missing mount point. Apr 27 10:02:53 devstack quobyte-client[81126]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 27 10:02:53 devstack quobyte-client[81126]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] database.db_retry_interval = 1 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] database.max_overflow = 50 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] database.max_pool_size = 5 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] database.max_retries = 10 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] database.mysql_wsrep_sync_wait = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] database.pool_timeout = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] database.retry_interval = 10 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] database.slave_connection = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] database.sqlite_synchronous = True {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] database.synchronous_reader = True {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] database.use_db_reconnect = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] profiler.connection_string = messaging:// {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] profiler.enabled = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] profiler.es_doc_type = notification {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] profiler.es_scroll_size = 10000 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] profiler.es_scroll_time = 2m {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] profiler.filter_error_trace = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] profiler.hmac_keys = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] profiler.sentinel_service_name = mymaster {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] profiler.socket_timeout = 0.1 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[81122]: DEBUG oslo_concurrency.processutils [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] CMD "mount.quobyte" returned: 1 in 0.075s {{(pid=81122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:02:53 devstack cinder-volume[81122]: DEBUG oslo_concurrency.lockutils [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:02:53 devstack cinder-volume[81122]: DEBUG oslo_concurrency.lockutils [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:02:53 devstack cinder-volume[81122]: DEBUG cinder.volume.drivers.quobyte [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:02:53 devstack cinder-volume[81122]: INFO cinder.volume.drivers.quobyte [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 ... Apr 27 10:02:53 devstack cinder-volume[81122]: DEBUG oslo_concurrency.processutils [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c -c /etc/quobyte/client-cinder.cfg {{(pid=81122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] profiler.trace_requests = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] profiler.trace_sqlalchemy = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] profiler_jaeger.process_tags = {} {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] profiler_jaeger.service_name_prefix = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] profiler_otlp.service_name_prefix = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_policy.enforce_new_defaults = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: WARNING oslo_config.cfg [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_policy.enforce_scope = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_policy.policy_default_rule = default {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_policy.policy_file = policy.yaml {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_policy.remote_timeout = 60.0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] privsep_osbrick.group = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] privsep_osbrick.helper_command = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] privsep_osbrick.user = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cinder_sys_admin.group = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cinder_sys_admin.helper_command = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] cinder_sys_admin.user = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] service_user.auth_section = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] service_user.auth_type = password {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] service_user.cafile = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] service_user.certfile = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] service_user.collect_timing = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] service_user.insecure = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] service_user.keyfile = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] service_user.send_service_user_token = True {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] service_user.split_loggers = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] service_user.timeout = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] glance.auth_section = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] glance.auth_type = password {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] glance.certfile = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] glance.collect_timing = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] glance.insecure = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] glance.keyfile = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] glance.region_name = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] glance.split_loggers = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] glance.timeout = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.backend_availability_zone = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.chap_password = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.chap_username = {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.disk_geometry = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.driver_client_cert = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.driver_client_cert_key = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.driver_data_namespace = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.driver_use_ssl = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.enable_unsupported_driver = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.extra_capabilities = {} {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.filter_function = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.goodness_function = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.iscsi_target_flags = {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.iscsi_write_cache = on {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.iser_helper = tgtadm {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.iser_ip_address = 192.168.122.125 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.iser_port = 3260 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.nas_host = {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.nas_login = admin {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.nas_mount_options = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.nas_password = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.nas_private_key = {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.nas_share_path = {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.nas_ssh_port = 22 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.num_shell_tries = 3 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.nvmet_port_id = 1 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.quobyte_client_cfg = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.quobyte_volume_url = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.replication_device = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.report_discard_supported = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.reserved_percentage = 0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.scst_target_driver = iscsi {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.scst_target_iqn_name = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.storage_protocol = iSCSI {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.target_helper = tgtadm {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.target_ip_address = 192.168.122.125 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.target_port = 3260 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.target_protocol = iscsi {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.trace_flags = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.unique_fqdn_network = True {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.use_chap_auth = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.volume_backend_name = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.volume_clear = zero {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.volume_clear_ionice = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.volume_clear_size = 0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_reports.file_event_handler = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_reports.log_dir = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.backend_availability_zone = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.backend_host = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.chap_password = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.chap_username = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.chiscsi_conf = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.disk_geometry = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.driver_client_cert = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.driver_client_cert_key = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.driver_data_namespace = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.driver_use_ssl = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.extra_capabilities = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.filter_function = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.goodness_function = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.iscsi_target_flags = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.iscsi_write_cache = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.iser_helper = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.iser_ip_address = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.iser_port = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.iser_target_prefix = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.nas_host = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.nas_login = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.nas_mount_options = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.nas_password = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.nas_private_key = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.nas_share_path = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.nas_ssh_port = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.num_shell_tries = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.nvmet_ns_id = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.nvmet_port_id = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack sudo[81127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c -c /etc/quobyte/client-cinder.cfg Apr 27 10:02:53 devstack sudo[81127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.replication_device = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.report_discard_supported = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.reserved_percentage = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.scst_target_driver = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.storage_protocol = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.target_helper = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.target_ip_address = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.target_port = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.target_prefix = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.target_protocol = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.trace_flags = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.unique_fqdn_network = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.use_chap_auth = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.volume_clear = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.volume_clear_ionice = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.volume_clear_size = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] QuobyteHD.volumes_dir = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.ssl = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.ssl_version = {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_notifications.driver = [] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_notifications.retry = -1 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] oslo_messaging_notifications.transport_url = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] key_manager.fixed_key = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican.barbican_api_version = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican.barbican_endpoint = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican.barbican_endpoint_type = public {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican.barbican_region_name = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican.cafile = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican.certfile = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican.collect_timing = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican.insecure = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican.keyfile = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican.number_of_retries = 60 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican.retry_delay = 1 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican.send_service_user_token = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican.split_loggers = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican.timeout = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican.verify_ssl = True {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican.verify_ssl_path = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican_service_user.auth_section = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican_service_user.auth_type = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican_service_user.cafile = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican_service_user.certfile = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican_service_user.collect_timing = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican_service_user.insecure = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican_service_user.keyfile = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican_service_user.split_loggers = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] barbican_service_user.timeout = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] vault.approle_role_id = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] vault.approle_secret_id = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] vault.kv_mountpoint = secret {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] vault.kv_path = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] vault.kv_version = 2 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] vault.namespace = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] vault.root_token_id = **** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] vault.ssl_ca_crt_file = None {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] vault.timeout = 60.0 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] vault.use_ssl = False {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:02:53 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] ******************************************************************************** {{(pid=80973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 27 10:02:53 devstack sudo[81127]: pam_unix(sudo:session): session closed for user root Apr 27 10:02:53 devstack cinder-volume[81122]: DEBUG oslo_concurrency.processutils [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.642s {{(pid=81122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:02:53 devstack cinder-volume[81122]: INFO cinder.volume.drivers.quobyte [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 succeeded Apr 27 10:02:54 devstack cinder-volume[81122]: DEBUG cinder.volume.drivers.quobyte [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:02:54 devstack cinder-volume[81122]: DEBUG oslo_concurrency.lockutils [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.650s {{(pid=81122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:02:54 devstack cinder-volume[81122]: DEBUG oslo_concurrency.processutils [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:02:54 devstack sudo[81196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:02:54 devstack sudo[81196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:02:54 devstack sudo[81196]: pam_unix(sudo:session): session closed for user root Apr 27 10:02:54 devstack cinder-volume[81122]: DEBUG oslo_concurrency.processutils [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.480s {{(pid=81122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:02:54 devstack cinder-volume[81122]: INFO cinder.volume.driver [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Driver hasn't implemented _init_vendor_properties() Apr 27 10:02:54 devstack cinder-volume[81122]: DEBUG cinder.volume.driver [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309875488281, 'free_capacity_gb': 1775.7309875488281, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81122) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 27 10:02:54 devstack cinder-volume[81122]: DEBUG oslo_db.sqlalchemy.engines [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81122) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 10:02:54 devstack cinder-volume[81122]: DEBUG dbcounter [-] [81122] Writer thread running {{(pid=81122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 27 10:02:54 devstack cinder-volume[81122]: DEBUG cinder.db.sqlalchemy.api [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Building query based on filter {{(pid=81122) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 27 10:02:54 devstack cinder-volume[81122]: DEBUG cinder.image.image_utils [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81122) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 27 10:02:54 devstack cinder-volume[81122]: INFO cinder.keymgr.migration [None req-472e9be1-e232-444e-819f-ec6ba469f38e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 27 10:02:54 devstack cinder-volume[81122]: DEBUG oslo_concurrency.lockutils [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:02:54 devstack cinder-volume[81122]: DEBUG oslo_concurrency.lockutils [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:02:54 devstack cinder-volume[81122]: DEBUG cinder.volume.drivers.quobyte [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:02:54 devstack cinder-volume[81122]: DEBUG cinder.volume.drivers.quobyte [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:02:54 devstack cinder-volume[81122]: DEBUG oslo_concurrency.lockutils [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:02:54 devstack cinder-volume[81122]: DEBUG oslo_concurrency.processutils [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:02:54 devstack sudo[81216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:02:54 devstack sudo[81216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:02:55 devstack sudo[81216]: pam_unix(sudo:session): session closed for user root Apr 27 10:02:55 devstack cinder-volume[81122]: DEBUG oslo_concurrency.processutils [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.493s {{(pid=81122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:02:55 devstack cinder-volume[81122]: DEBUG cinder.manager [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Notifying Schedulers of capabilities ... {{(pid=81122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:02:55 devstack cinder-volume[81122]: INFO cinder.volume.manager [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Driver initialization completed successfully. Apr 27 10:02:55 devstack cinder-volume[81122]: INFO cinder.manager [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Initiating service 3 cleanup Apr 27 10:02:55 devstack cinder-volume[81122]: INFO cinder.manager [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Service 3 cleanup completed. Apr 27 10:02:55 devstack cinder-volume[81122]: DEBUG cinder.service [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Creating RPC server for service cinder-volume {{(pid=81122) start /opt/stack/cinder/cinder/service.py:231}} Apr 27 10:02:55 devstack cinder-volume[81122]: DEBUG cinder.service [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81122) start /opt/stack/cinder/cinder/service.py:237}} Apr 27 10:02:55 devstack cinder-volume[81122]: INFO cinder.volume.manager [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 27 10:02:55 devstack cinder-volume[81122]: DEBUG oslo_concurrency.lockutils [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:02:55 devstack cinder-volume[81122]: DEBUG oslo_concurrency.lockutils [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:02:55 devstack cinder-volume[81122]: DEBUG cinder.volume.drivers.quobyte [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:02:55 devstack cinder-volume[81122]: DEBUG cinder.volume.drivers.quobyte [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:02:55 devstack cinder-volume[81122]: DEBUG oslo_concurrency.lockutils [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:02:55 devstack cinder-volume[81122]: DEBUG oslo_concurrency.processutils [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:02:55 devstack sudo[81261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:02:55 devstack sudo[81261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:02:55 devstack sudo[81261]: pam_unix(sudo:session): session closed for user root Apr 27 10:02:55 devstack cinder-volume[81122]: DEBUG oslo_concurrency.processutils [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.652s {{(pid=81122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:02:55 devstack cinder-volume[81122]: INFO cinder.volume.manager [None req-61f4f91c-50a2-46b9-90e2-f8b8e522ce62 None None] Driver post RPC initialization completed successfully. Apr 27 10:02:57 devstack cinder-volume[80973]: INFO oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Caught SIGTERM, stopping children Apr 27 10:02:57 devstack cinder-volume[80973]: DEBUG oslo_concurrency.lockutils [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Acquiring lock "singleton_lock" {{(pid=80973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 27 10:02:57 devstack cinder-volume[80973]: DEBUG oslo_concurrency.lockutils [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Acquired lock "singleton_lock" {{(pid=80973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 27 10:02:57 devstack cinder-volume[80973]: DEBUG oslo_concurrency.lockutils [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Releasing lock "singleton_lock" {{(pid=80973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 27 10:02:57 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Stop services. {{(pid=80973) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 27 10:02:57 devstack cinder-volume[80973]: DEBUG oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Killing children. {{(pid=80973) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 27 10:02:57 devstack cinder-volume[80973]: INFO oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Waiting on 1 children to exit Apr 27 10:02:57 devstack cinder-volume[81122]: DEBUG oslo_concurrency.lockutils [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Acquiring lock "singleton_lock" {{(pid=81122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 27 10:02:57 devstack cinder-volume[81122]: DEBUG oslo_concurrency.lockutils [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Acquired lock "singleton_lock" {{(pid=81122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 27 10:02:57 devstack cinder-volume[81122]: DEBUG oslo_concurrency.lockutils [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Releasing lock "singleton_lock" {{(pid=81122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 27 10:02:57 devstack cinder-volume[81122]: WARNING amqp [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 27 10:02:57 devstack cinder-volume[81122]: WARNING amqp [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 27 10:02:57 devstack cinder-volume[80973]: INFO oslo_service.backend._eventlet.service [None req-0e759d11-9458-4dbb-8425-6828ffcb4306 None None] Child 81122 exited with status 0 Apr 27 10:02:57 devstack cinder-volume[81341]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 27 10:02:57 devstack cinder-volume[81341]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 27 10:02:57 devstack cinder-volume[81341]: we strongly recommend against using it for new projects. Apr 27 10:02:57 devstack cinder-volume[81341]: If you are already using Eventlet, we recommend migrating to a different Apr 27 10:02:57 devstack cinder-volume[81341]: framework. For more detail see Apr 27 10:02:57 devstack cinder-volume[81341]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 27 10:02:57 devstack cinder-volume[81341]: import eventlet # noqa Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 27 10:02:59 devstack cinder-volume[81341]: INFO dbcounter [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] Registered counter for database cinder Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_db.sqlalchemy.engines [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81341) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG dbcounter [-] [81341] Writer thread running {{(pid=81341) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 27 10:02:59 devstack cinder-volume[81341]: INFO cinder.rpc [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 27 10:02:59 devstack cinder-volume[81341]: INFO cinder.rpc [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_db.sqlalchemy.engines [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81341) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 10:02:59 devstack cinder-volume[81341]: INFO cinder.volume.manager [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] Determined volume DB was empty at startup. Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG cinder.volume.manager [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81341) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 27 10:02:59 devstack cinder-volume[81341]: WARNING stevedore.named [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 27 10:02:59 devstack cinder-volume[81341]: WARNING castellan.key_manager [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 27 10:02:59 devstack cinder-volume[81341]: WARNING cinder.keymgr.conf_key_mgr [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 27 10:02:59 devstack cinder-volume[81341]: INFO cinder.volume.manager [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_db.sqlalchemy.engines [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81341) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 10:02:59 devstack cinder-volume[81341]: INFO oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] Starting 1 workers Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] Started child 81350 {{(pid=81341) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 27 10:02:59 devstack cinder-volume[81350]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] Full set of CONF: {{(pid=81341) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] ******************************************************************************** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] Configuration options gathered from: {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] ================================================================================ {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] allow_availability_zone_fallback = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] allow_compression_on_image_upload = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] allowed_direct_url_schemes = [] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] api_rate_limit = True {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] auth_strategy = keystone {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_availability_zone = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_host = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_name = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_stats_polling_interval = 60 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backup_api_class = cinder.backup.api.API {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backup_name_template = backup-%s {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backup_use_same_host = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backup_use_temp_snapshot = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] chap_password = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] chap_username = {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cinder_internal_tenant_project_id = 05d623aefeae48318d38ecbb7afd7efc {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cinder_internal_tenant_user_id = 2c15003be5ce4762be451ef81437589d {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cluster = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] compression_format = gzip {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] compute_api_class = cinder.compute.nova.API {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] config_dir = [] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] config_source = [] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:02:59 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] control_exchange = openstack {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] debug = True {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] default_availability_zone = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] default_group_type = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] default_volume_type = QuobyteHD {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] disk_geometry = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] driver_client_cert = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] driver_client_cert_key = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] driver_data_namespace = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] driver_ssl_cert_path = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] driver_ssl_cert_verify = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] driver_use_ssl = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] enable_new_services = True {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Starting volume driver QuobyteDriver (1.1.14) Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] enable_unsupported_driver = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81350) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] enabled_backends = ['QuobyteHD'] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] enforce_multipath_for_image_xfer = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] filter_function = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] glance_api_insecure = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] glance_api_servers = ['http://192.168.122.125/image'] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] glance_api_ssl_compression = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] glance_ca_certificates_file = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] glance_catalog_info = image:glance:publicURL {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] glance_certfile = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] glance_keyfile = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] glance_num_retries = 3 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] glance_request_timeout = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] goodness_function = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] graceful_shutdown_timeout = 5 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] group_api_class = cinder.group.api.API {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] host = devstack {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] image_compress_on_upload = True {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] image_conversion_address_space_limit = 1 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] image_conversion_cpu_limit = 60 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] image_conversion_disable = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] image_upload_use_cinder_backend = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] image_upload_use_internal_tenant = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] image_volume_cache_enabled = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] image_volume_cache_max_count = 0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] image_volume_cache_max_size_gb = 0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] init_host_max_objects_retrieval = 0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] instance_format = [instance: %(uuid)s] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] iscsi_target_flags = {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] iscsi_write_cache = on {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] iser_helper = tgtadm {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] iser_ip_address = 192.168.122.125 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] iser_port = 3260 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] log_color = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] log_config_append = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] log_dir = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] log_file = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] log_options = True {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] log_rotate_interval = 1 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] log_rotate_interval_type = days {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] log_rotation_type = none {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] max_age = 0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] max_logfile_count = 30 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] max_logfile_size_mb = 200 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] max_over_subscription_ratio = 20.0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] message_reap_interval = 86400 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] message_ttl = 2592000 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] migration_create_volume_timeout_secs = 300 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] monkey_patch = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] monkey_patch_modules = [] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] my_ip = 192.168.122.125 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] no_snapshot_gb_quota = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] num_iser_scan_tries = 3 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] num_shell_tries = 3 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] num_volume_device_scan_tries = 3 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] nvmeof_conn_info_version = 1 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] nvmet_ns_id = 10 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] nvmet_port_id = 1 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] osapi_max_limit = 1000 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] osapi_volume_ext_list = [] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] osapi_volume_listen_port = 8776 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] osapi_volume_use_ssl = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] osapi_volume_workers = 2 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] per_volume_size_limit = -1 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] periodic_fuzzy_delay = 60 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] periodic_interval = 60 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] public_endpoint = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] publish_errors = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] quota_backup_gigabytes = 1000 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] quota_backups = 10 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] quota_gigabytes = 1000 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] quota_groups = 10 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] quota_snapshots = 10 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] quota_volumes = 10 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] rate_limit_burst = 0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] rate_limit_except_level = CRITICAL {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] rate_limit_interval = 0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] reinit_driver_count = 3 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] replication_device = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] report_discard_supported = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] report_interval = 120 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] reservation_clean_interval = 86400 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] reservation_expire = 86400 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] reserved_image_namespaces = [] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] reserved_percentage = 0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] rpc_response_timeout = 120 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] run_external_periodic_tasks = True {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] scst_target_driver = iscsi {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] scst_target_iqn_name = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] service_down_time = 720 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] shell_completion = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] snapshot_name_template = snapshot-%s {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] split_loggers = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] state_path = /opt/stack/data/cinder {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] storage_availability_zone = nova {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] storage_protocol = iSCSI {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] syslog_log_facility = LOG_USER {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] target_helper = lioadm {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] target_ip_address = 192.168.122.125 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] target_port = 3260 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] target_protocol = iscsi {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] target_secondary_ip_addresses = [] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] trace_flags = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] transport_url = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] until_refresh = 0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] use_chap_auth = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] use_default_quota_class = True {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] use_journal = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] use_json = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] use_multipath_for_image_xfer = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] use_stderr = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] use_syslog = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] verify_glance_signatures = enabled {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] volume_api_class = cinder.volume.api.API {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] volume_backend_name = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] volume_clear = zero {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] volume_clear_ionice = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] volume_clear_size = 0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] volume_copy_bps_limit = 0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] volume_dd_blocksize = 1M {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] volume_name_template = volume-%s {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] volume_service_inithost_offload = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] volume_usage_audit_period = month {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] zoning_mode = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_concurrency.disable_process_locking = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.admin_password = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.admin_token = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.admin_user = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.auth_port = 35357 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.auth_protocol = https {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.auth_section = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.auth_type = password {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.auth_uri = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.auth_version = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.cache = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.certfile = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.identity_uri = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.include_service_catalog = True {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.insecure = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.interface = public {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.keyfile = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.memcache_password = {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.memcache_username = {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.region_name = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.service_type = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.125/identity {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.backend = dogpile.cache.null {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.backend_argument = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.backend_expiration_time = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.config_prefix = cache.oslo {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.debug_cache_backend = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.enable_retry_client = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.enable_socket_keepalive = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.enabled = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.enforce_fips_mode = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.expiration_time = 600 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.hashclient_retry_attempts = 2 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.memcache_dead_retry = 300 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.memcache_pool_maxsize = 10 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.memcache_sasl_enabled = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.password = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.proxies = [] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.redis_db = 0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.redis_server = localhost:6379 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.retry_attempts = 2 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.retry_delay = 0.0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.socket_keepalive_count = 1 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.socket_keepalive_idle = 1 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.socket_keepalive_interval = 1 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.socket_timeout = 1.0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.tls_allowed_ciphers = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.tls_cafile = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.tls_certfile = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.tls_enabled = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.tls_keyfile = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cache.username = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] coordination.backend_url = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] database.asyncio_connection = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] database.asyncio_slave_connection = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] database.backend = sqlalchemy {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] database.connection = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] database.connection_debug = 0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] database.connection_parameters = {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] database.connection_recycle_time = 3600 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] database.connection_trace = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] database.db_inc_retry_interval = True {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] database.db_max_retries = 20 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] database.db_max_retry_interval = 10 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] database.db_retry_interval = 1 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] database.max_overflow = 50 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] database.max_pool_size = 5 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] database.max_retries = 10 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] database.mysql_wsrep_sync_wait = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] database.pool_timeout = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] database.retry_interval = 10 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] database.slave_connection = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] database.sqlite_synchronous = True {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] database.synchronous_reader = True {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] database.use_db_reconnect = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] profiler.connection_string = messaging:// {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] profiler.enabled = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] profiler.es_doc_type = notification {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] profiler.es_scroll_size = 10000 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] profiler.es_scroll_time = 2m {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] profiler.filter_error_trace = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] profiler.hmac_keys = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] profiler.sentinel_service_name = mymaster {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] profiler.socket_timeout = 0.1 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] profiler.trace_requests = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] profiler.trace_sqlalchemy = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] profiler_jaeger.process_tags = {} {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] profiler_jaeger.service_name_prefix = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] profiler_otlp.service_name_prefix = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_policy.enforce_new_defaults = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81350) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 27 10:03:00 devstack cinder-volume[81341]: WARNING oslo_config.cfg [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 27 10:03:00 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.quobyte [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 27 10:03:00 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.quobyte [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_policy.enforce_scope = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_policy.policy_default_rule = default {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_policy.policy_file = policy.yaml {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Running cmd (subprocess): mount.quobyte {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] privsep_osbrick.group = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] privsep_osbrick.helper_command = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] privsep_osbrick.user = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cinder_sys_admin.group = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cinder_sys_admin.helper_command = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] cinder_sys_admin.user = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] service_user.auth_section = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] service_user.auth_type = password {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] service_user.cafile = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] service_user.certfile = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] service_user.collect_timing = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] service_user.insecure = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] service_user.keyfile = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] service_user.send_service_user_token = True {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] service_user.split_loggers = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] service_user.timeout = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] glance.auth_section = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] glance.auth_type = password {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] glance.certfile = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] glance.collect_timing = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] glance.insecure = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] glance.keyfile = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] glance.region_name = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] glance.split_loggers = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] glance.timeout = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.backend_availability_zone = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.chap_password = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.chap_username = {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.disk_geometry = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.driver_client_cert = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.driver_client_cert_key = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.driver_data_namespace = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.driver_use_ssl = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack quobyte-client[81354]: Reading configuration file: /etc/quobyte/client.cfg Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.extra_capabilities = {} {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.filter_function = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.goodness_function = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack quobyte-client[81354]: Invalid parameters found, error: missing mount point. Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.iscsi_target_flags = {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.iscsi_write_cache = on {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.iser_helper = tgtadm {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.iser_ip_address = 192.168.122.125 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack quobyte-client[81354]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.iser_port = 3260 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.nas_host = {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.nas_login = admin {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.nas_mount_options = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack quobyte-client[81354]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.nas_password = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.nas_private_key = {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.nas_share_path = {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.num_shell_tries = 3 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.quobyte_volume_url = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.replication_device = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.report_discard_supported = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.reserved_percentage = 0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.target_helper = tgtadm {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.target_ip_address = 192.168.122.125 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.target_port = 3260 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.target_protocol = iscsi {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.trace_flags = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.unique_fqdn_network = True {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.use_chap_auth = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.volume_backend_name = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.volume_clear = zero {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.volume_clear_ionice = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.volume_clear_size = 0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_reports.file_event_handler = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_reports.log_dir = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.backend_availability_zone = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.backend_host = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.chap_password = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.chap_username = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.chiscsi_conf = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.disk_geometry = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.driver_client_cert = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.driver_data_namespace = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.driver_use_ssl = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.extra_capabilities = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.filter_function = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.goodness_function = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.iser_helper = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.iser_ip_address = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack sudo[81355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.iser_port = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.iser_target_prefix = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.nas_host = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.nas_login = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.nas_mount_options = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.nas_password = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack sudo[81355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.nas_private_key = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.nas_share_path = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.nas_ssh_port = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.num_shell_tries = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.nvmet_port_id = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.replication_device = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.report_discard_supported = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.reserved_percentage = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.scst_target_driver = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.storage_protocol = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.target_helper = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.target_ip_address = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.target_port = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.target_prefix = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.target_protocol = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] CMD "mount.quobyte" returned: 1 in 0.052s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.trace_flags = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.use_chap_auth = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.volume_clear = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.volume_clear_size = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] QuobyteHD.volumes_dir = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.ssl = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_notifications.driver = [] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_notifications.retry = -1 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] key_manager.fixed_key = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican.barbican_api_version = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican.barbican_endpoint = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican.barbican_endpoint_type = public {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican.barbican_region_name = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican.cafile = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican.certfile = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican.collect_timing = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican.insecure = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican.keyfile = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican.number_of_retries = 60 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican.retry_delay = 1 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican.send_service_user_token = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican.split_loggers = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican.timeout = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican.verify_ssl = True {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican.verify_ssl_path = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican_service_user.auth_section = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican_service_user.auth_type = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican_service_user.cafile = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican_service_user.certfile = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican_service_user.collect_timing = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican_service_user.insecure = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican_service_user.keyfile = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican_service_user.split_loggers = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] barbican_service_user.timeout = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] vault.approle_role_id = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] vault.approle_secret_id = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] vault.kv_mountpoint = secret {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] vault.kv_path = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] vault.kv_version = 2 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] vault.namespace = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] vault.root_token_id = **** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] vault.ssl_ca_crt_file = None {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] vault.timeout = 60.0 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] vault.use_ssl = False {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 10:03:00 devstack cinder-volume[81341]: DEBUG oslo_service.backend._eventlet.service [None req-fc45f1df-1b82-4b49-bc4b-1cddbcb82a24 None None] ******************************************************************************** {{(pid=81341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 27 10:03:00 devstack sudo[81355]: pam_unix(sudo:session): session closed for user root Apr 27 10:03:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.385s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:03:00 devstack cinder-volume[81350]: INFO cinder.volume.driver [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Driver hasn't implemented _init_vendor_properties() Apr 27 10:03:00 devstack cinder-volume[81350]: DEBUG cinder.volume.driver [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309875488281, 'free_capacity_gb': 1775.7309875488281, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81350) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 27 10:03:00 devstack cinder-volume[81350]: DEBUG oslo_db.sqlalchemy.engines [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81350) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 10:03:00 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writer thread running {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 27 10:03:00 devstack cinder-volume[81350]: DEBUG cinder.db.sqlalchemy.api [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Building query based on filter {{(pid=81350) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 27 10:03:00 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81350) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 27 10:03:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:03:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:03:00 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:03:00 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:03:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:03:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:03:00 devstack cinder-volume[81350]: INFO cinder.keymgr.migration [None req-3ec9ae9d-d3a9-44f2-80de-da4c1689fb80 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 27 10:03:00 devstack sudo[81359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:03:00 devstack sudo[81359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:03:01 devstack sudo[81359]: pam_unix(sudo:session): session closed for user root Apr 27 10:03:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.403s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:03:01 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:03:01 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Driver initialization completed successfully. Apr 27 10:03:01 devstack cinder-volume[81350]: INFO cinder.manager [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Initiating service 3 cleanup Apr 27 10:03:01 devstack cinder-volume[81350]: INFO cinder.manager [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Service 3 cleanup completed. Apr 27 10:03:01 devstack cinder-volume[81350]: DEBUG cinder.service [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Creating RPC server for service cinder-volume {{(pid=81350) start /opt/stack/cinder/cinder/service.py:231}} Apr 27 10:03:01 devstack cinder-volume[81350]: DEBUG cinder.service [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81350) start /opt/stack/cinder/cinder/service.py:237}} Apr 27 10:03:01 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 27 10:03:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:03:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:03:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:03:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:03:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:03:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:03:01 devstack sudo[81366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:03:01 devstack sudo[81366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:03:01 devstack sudo[81366]: pam_unix(sudo:session): session closed for user root Apr 27 10:03:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.449s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:03:01 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-b4f14456-19d7-438b-9b53-1353a017487e None None] Driver post RPC initialization completed successfully. Apr 27 10:03:09 devstack cinder-volume[81341]: DEBUG dbcounter [-] [81341] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81341) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:03:11 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:SELECT=1 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:03:11 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:04:16 devstack cinder-volume[81350]: DEBUG oslo_service.periodic_task [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81350) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 10:04:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:04:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:04:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:04:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:04:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:04:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:04:16 devstack sudo[81516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:04:16 devstack sudo[81516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:04:17 devstack sudo[81516]: pam_unix(sudo:session): session closed for user root Apr 27 10:04:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.396s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:04:17 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:05:05 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:05:05 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Flow 'volume_create_manager' (11acbef7-ddf2-404a-b932-a5bf4db544b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:05:05 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f3545b-8b83-4ff5-965b-3edafa20cd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:05 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f3545b-8b83-4ff5-965b-3edafa20cd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-655532156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cdbc2b2-8cc3-4583-92b8-6012f94daac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ff72dc8c204abcaf7de5d88829c460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:05:06Z,use_quota=True,user_id='bd5182623f2d4501a0f4ef4e87ea770d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:05 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37240473-3fcc-43ba-bfbb-785aaf02d024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:05 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37240473-3fcc-43ba-bfbb-785aaf02d024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:05 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501d1793-fac9-4cd1-8548-59c7c97d9790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:05 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501d1793-fac9-4cd1-8548-59c7c97d9790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cdbc2b2-8cc3-4583-92b8-6012f94daac7', 'volume_name': 'volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:05 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fecfed1-32d5-4857-8a14-5fa59d9649f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:05 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fecfed1-32d5-4857-8a14-5fa59d9649f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:05 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f8102a-b0bc-4b2c-b539-eb126bad7a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:05 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Volume 6cdbc2b2-8cc3-4583-92b8-6012f94daac7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7', 'volume_size': 1} Apr 27 10:05:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:05:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:05:05 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-655532156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cdbc2b2-8cc3-4583-92b8-6012f94daac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ff72dc8c204abcaf7de5d88829c460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:05:06Z,use_quota=True,user_id='bd5182623f2d4501a0f4ef4e87ea770d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:05:05 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Creating volume 6cdbc2b2-8cc3-4583-92b8-6012f94daac7 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:05:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:05:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:05:05 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:05:05 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:05:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:05:05 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:05:05 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:05:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:05 devstack sudo[81955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7 1073741824 Apr 27 10:05:05 devstack sudo[81955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:06 devstack sudo[81955]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7 1073741824" returned: 0 in 0.782s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:06 devstack sudo[82273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7 Apr 27 10:05:06 devstack sudo[82273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:07 devstack sudo[82273]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7" returned: 0 in 0.522s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:07 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:05:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:05:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f8102a-b0bc-4b2c-b539-eb126bad7a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef6ef6a-8871-4dd1-8023-3d16a88e4cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:07 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Volume volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7 (6cdbc2b2-8cc3-4583-92b8-6012f94daac7): created successfully Apr 27 10:05:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef6ef6a-8871-4dd1-8023-3d16a88e4cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Flow 'volume_create_manager' (11acbef7-ddf2-404a-b932-a5bf4db544b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:05:07 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-d126213f-362f-40dd-85a3-2cbc7064e24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Created volume successfully. Apr 27 10:05:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-43e439fa-5a69-4687-bece-9025e5f22784 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:05:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-43e439fa-5a69-4687-bece-9025e5f22784 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:05:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-43e439fa-5a69-4687-bece-9025e5f22784 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Creating offline snapshot bfd7d32e-b203-4d46-b91f-13f3b620a547 of volume 6cdbc2b2-8cc3-4583-92b8-6012f94daac7 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:05:08 devstack cinder-volume[81350]: INFO oslo.privsep.daemon [None req-43e439fa-5a69-4687-bece-9025e5f22784 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpqp8zp5zx/privsep.sock'] Apr 27 10:05:08 devstack sudo[82276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpqp8zp5zx/privsep.sock Apr 27 10:05:08 devstack sudo[82276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:08 devstack cinder-volume[81350]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 27 10:05:08 devstack cinder-volume[81350]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 27 10:05:08 devstack cinder-volume[81350]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 27 10:05:08 devstack cinder-volume[81350]: WARNING oslo.privsep.daemon [-] privsep log: Apr 27 10:05:08 devstack cinder-volume[81350]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 27 10:05:08 devstack cinder-volume[81350]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 27 10:05:08 devstack cinder-volume[81350]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 27 10:05:08 devstack cinder-volume[81350]: WARNING oslo.privsep.daemon [-] privsep log: Apr 27 10:05:08 devstack cinder-volume[81350]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 27 10:05:08 devstack cinder-volume[81350]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 27 10:05:08 devstack cinder-volume[81350]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 27 10:05:08 devstack cinder-volume[81350]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 27 10:05:08 devstack cinder-volume[81350]: WARNING oslo.privsep.daemon [-] privsep log: Apr 27 10:05:08 devstack cinder-volume[81350]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 27 10:05:08 devstack cinder-volume[81350]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 27 10:05:08 devstack cinder-volume[81350]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 27 10:05:08 devstack cinder-volume[81350]: WARNING oslo.privsep.daemon [-] privsep log: Apr 27 10:05:08 devstack cinder-volume[81350]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 27 10:05:09 devstack sudo[82276]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:09 devstack cinder-volume[81350]: INFO oslo.privsep.daemon [None req-43e439fa-5a69-4687-bece-9025e5f22784 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Spawned new privsep daemon via rootwrap Apr 27 10:05:09 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [None req-43e439fa-5a69-4687-bece-9025e5f22784 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Accepted privsep connection to /tmp/tmpqp8zp5zx/privsep.sock {{(pid=81350) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 27 10:05:09 devstack cinder-volume[81350]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 27 10:05:09 devstack cinder-volume[81350]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 27 10:05:09 devstack cinder-volume[81350]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 27 10:05:09 devstack cinder-volume[81350]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82279 Apr 27 10:05:09 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[158e030f-8b1d-4f83-a58c-6f7d9b783bc1]: (2,) {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:05:09 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3715cd9-088d-4a96-993f-9cd5ffbb4b6e]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:05:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-43e439fa-5a69-4687-bece-9025e5f22784 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:09 devstack sudo[82281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7 Apr 27 10:05:09 devstack sudo[82281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:10 devstack sudo[82281]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-43e439fa-5a69-4687-bece-9025e5f22784 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7" returned: 0 in 0.638s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-43e439fa-5a69-4687-bece-9025e5f22784 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.bfd7d32e-b203-4d46-b91f-13f3b620a547 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:10 devstack sudo[82286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.bfd7d32e-b203-4d46-b91f-13f3b620a547 1G Apr 27 10:05:10 devstack sudo[82286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:10 devstack sudo[82286]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-43e439fa-5a69-4687-bece-9025e5f22784 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.bfd7d32e-b203-4d46-b91f-13f3b620a547 1G" returned: 0 in 0.696s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-43e439fa-5a69-4687-bece-9025e5f22784 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.bfd7d32e-b203-4d46-b91f-13f3b620a547 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:10 devstack sudo[82291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.bfd7d32e-b203-4d46-b91f-13f3b620a547 Apr 27 10:05:10 devstack sudo[82291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:11 devstack sudo[82291]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-43e439fa-5a69-4687-bece-9025e5f22784 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.bfd7d32e-b203-4d46-b91f-13f3b620a547" returned: 0 in 0.579s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:11 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-43e439fa-5a69-4687-bece-9025e5f22784 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.bfd7d32e-b203-4d46-b91f-13f3b620a547 is being set with open permissions: ugo+rw Apr 27 10:05:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-43e439fa-5a69-4687-bece-9025e5f22784 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.bfd7d32e-b203-4d46-b91f-13f3b620a547 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:11 devstack sudo[82296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.bfd7d32e-b203-4d46-b91f-13f3b620a547 Apr 27 10:05:11 devstack sudo[82296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:12 devstack sudo[82296]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-43e439fa-5a69-4687-bece-9025e5f22784 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.bfd7d32e-b203-4d46-b91f-13f3b620a547" returned: 0 in 0.641s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-43e439fa-5a69-4687-bece-9025e5f22784 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:12 devstack sudo[82299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.info Apr 27 10:05:12 devstack sudo[82299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:12 devstack sudo[82299]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-43e439fa-5a69-4687-bece-9025e5f22784 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.info" returned: 0 in 0.584s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:12 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-43e439fa-5a69-4687-bece-9025e5f22784 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.info is being set with open permissions: ugo+rw Apr 27 10:05:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-43e439fa-5a69-4687-bece-9025e5f22784 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:12 devstack sudo[82302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.info Apr 27 10:05:12 devstack sudo[82302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:13 devstack sudo[82302]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-43e439fa-5a69-4687-bece-9025e5f22784 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.info" returned: 0 in 0.452s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-43e439fa-5a69-4687-bece-9025e5f22784 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.019s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:05:13 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-43e439fa-5a69-4687-bece-9025e5f22784 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Create snapshot completed successfully Apr 27 10:05:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fa713417-eb5d-4b62-a193-07dc43108976 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Acquiring lock "cinder-bfd7d32e-b203-4d46-b91f-13f3b620a547-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:05:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fa713417-eb5d-4b62-a193-07dc43108976 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Lock "cinder-bfd7d32e-b203-4d46-b91f-13f3b620a547-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:05:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fa713417-eb5d-4b62-a193-07dc43108976 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Acquiring lock "cinder-quobyte-6cdbc2b2-8cc3-4583-92b8-6012f94daac7" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:05:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fa713417-eb5d-4b62-a193-07dc43108976 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Lock "cinder-quobyte-6cdbc2b2-8cc3-4583-92b8-6012f94daac7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:05:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fa713417-eb5d-4b62-a193-07dc43108976 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Acquiring lock "cinder-quobyte-bfd7d32e-b203-4d46-b91f-13f3b620a547" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:05:14 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fa713417-eb5d-4b62-a193-07dc43108976 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Lock "cinder-quobyte-bfd7d32e-b203-4d46-b91f-13f3b620a547" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:05:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-fa713417-eb5d-4b62-a193-07dc43108976 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Deleting offline snapshot bfd7d32e-b203-4d46-b91f-13f3b620a547 of volume 6cdbc2b2-8cc3-4583-92b8-6012f94daac7 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:05:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-fa713417-eb5d-4b62-a193-07dc43108976 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] snapshot_file for this snap is: volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.bfd7d32e-b203-4d46-b91f-13f3b620a547 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:05:14 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1780b723-cd52-4412-ba1b-864acf8b044b]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:05:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fa713417-eb5d-4b62-a193-07dc43108976 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.bfd7d32e-b203-4d46-b91f-13f3b620a547 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:14 devstack sudo[82310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.bfd7d32e-b203-4d46-b91f-13f3b620a547 Apr 27 10:05:14 devstack sudo[82310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:14 devstack sudo[82310]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fa713417-eb5d-4b62-a193-07dc43108976 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.bfd7d32e-b203-4d46-b91f-13f3b620a547" returned: 0 in 0.734s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-fa713417-eb5d-4b62-a193-07dc43108976 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:05:14 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[57696e9d-1710-41ab-b3fe-3a3e96befe9b]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:05:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fa713417-eb5d-4b62-a193-07dc43108976 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:14 devstack sudo[82326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7 Apr 27 10:05:14 devstack sudo[82326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:15 devstack sudo[82326]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fa713417-eb5d-4b62-a193-07dc43108976 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7" returned: 0 in 0.790s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fa713417-eb5d-4b62-a193-07dc43108976 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.bfd7d32e-b203-4d46-b91f-13f3b620a547 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:15 devstack sudo[82333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.bfd7d32e-b203-4d46-b91f-13f3b620a547 Apr 27 10:05:15 devstack sudo[82333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:16 devstack sudo[82333]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fa713417-eb5d-4b62-a193-07dc43108976 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.bfd7d32e-b203-4d46-b91f-13f3b620a547" returned: 0 in 0.682s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fa713417-eb5d-4b62-a193-07dc43108976 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.bfd7d32e-b203-4d46-b91f-13f3b620a547 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:16 devstack sudo[82342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.bfd7d32e-b203-4d46-b91f-13f3b620a547 Apr 27 10:05:16 devstack sudo[82342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:16 devstack cinder-volume[81350]: DEBUG oslo_service.periodic_task [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81350) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 10:05:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:05:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:05:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:05:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:05:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:05:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:16 devstack sudo[82348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:05:16 devstack sudo[82348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:16 devstack sudo[82342]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fa713417-eb5d-4b62-a193-07dc43108976 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7.bfd7d32e-b203-4d46-b91f-13f3b620a547" returned: 0 in 0.661s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:17 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fa713417-eb5d-4b62-a193-07dc43108976 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Lock "cinder-quobyte-bfd7d32e-b203-4d46-b91f-13f3b620a547" released by "_delete_snapshot" :: held 3.011s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:05:17 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fa713417-eb5d-4b62-a193-07dc43108976 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Lock "cinder-quobyte-6cdbc2b2-8cc3-4583-92b8-6012f94daac7" released by "delete_snapshot" :: held 3.043s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:05:17 devstack cinder-volume[81350]: WARNING cinder.quota [None req-fa713417-eb5d-4b62-a193-07dc43108976 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:05:17 devstack cinder-volume[81350]: WARNING cinder.quota [None req-fa713417-eb5d-4b62-a193-07dc43108976 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:05:17 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-fa713417-eb5d-4b62-a193-07dc43108976 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Created reservations ['91e868b5-3c07-4b98-8488-000352288b89', 'b940f9bc-dd3e-48b8-8f2a-2c68253669f4', '642b27bf-e196-4360-8056-ebe5782465c3', '72ddc1ca-b5c1-48a9-9e4f-02a49948fb1c'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:05:17 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-fa713417-eb5d-4b62-a193-07dc43108976 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Delete snapshot completed successfully. Apr 27 10:05:17 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fa713417-eb5d-4b62-a193-07dc43108976 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Lock "cinder-bfd7d32e-b203-4d46-b91f-13f3b620a547-delete_snapshot" released by "delete_snapshot" :: held 3.398s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:05:17 devstack sudo[82348]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.736s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:17 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:05:18 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d45a0ba3-67da-4744-97c3-52fe9ae88925 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Acquiring lock "cinder-6cdbc2b2-8cc3-4583-92b8-6012f94daac7-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:05:18 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d45a0ba3-67da-4744-97c3-52fe9ae88925 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Lock "cinder-6cdbc2b2-8cc3-4583-92b8-6012f94daac7-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:05:18 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d45a0ba3-67da-4744-97c3-52fe9ae88925 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Acquiring lock "cinder-quobyte-6cdbc2b2-8cc3-4583-92b8-6012f94daac7" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:05:18 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d45a0ba3-67da-4744-97c3-52fe9ae88925 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Lock "cinder-quobyte-6cdbc2b2-8cc3-4583-92b8-6012f94daac7" acquired by "delete_volume" :: waited 0.041s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:05:18 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55d485b-1355-4f71-95b4-70325abf380b]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:05:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d45a0ba3-67da-4744-97c3-52fe9ae88925 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:18 devstack sudo[82371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7 Apr 27 10:05:18 devstack sudo[82371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:19 devstack sudo[82371]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d45a0ba3-67da-4744-97c3-52fe9ae88925 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7" returned: 0 in 0.772s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d45a0ba3-67da-4744-97c3-52fe9ae88925 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:19 devstack sudo[82409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7 Apr 27 10:05:19 devstack sudo[82409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:20 devstack sudo[82409]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d45a0ba3-67da-4744-97c3-52fe9ae88925 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cdbc2b2-8cc3-4583-92b8-6012f94daac7" returned: 0 in 1.333s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:20 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d45a0ba3-67da-4744-97c3-52fe9ae88925 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Lock "cinder-quobyte-6cdbc2b2-8cc3-4583-92b8-6012f94daac7" released by "delete_volume" :: held 2.221s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:05:20 devstack cinder-volume[81350]: WARNING cinder.quota [None req-d45a0ba3-67da-4744-97c3-52fe9ae88925 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:05:20 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-d45a0ba3-67da-4744-97c3-52fe9ae88925 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Created reservations ['47fa2315-ca21-47da-a1c7-cc9785a43ea0', 'eaf37306-e43e-43f5-bace-ee7f4922e068', '96d4e896-bc7f-463e-8449-d32692b93bd9', 'aa498607-95f7-42d7-88a4-775a63f39509'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:05:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d45a0ba3-67da-4744-97c3-52fe9ae88925 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:05:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d45a0ba3-67da-4744-97c3-52fe9ae88925 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:05:20 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d45a0ba3-67da-4744-97c3-52fe9ae88925 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:05:20 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d45a0ba3-67da-4744-97c3-52fe9ae88925 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:05:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d45a0ba3-67da-4744-97c3-52fe9ae88925 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:05:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d45a0ba3-67da-4744-97c3-52fe9ae88925 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:21 devstack sudo[82446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:05:21 devstack sudo[82446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:21 devstack sudo[82446]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d45a0ba3-67da-4744-97c3-52fe9ae88925 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 1.020s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:21 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-d45a0ba3-67da-4744-97c3-52fe9ae88925 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:05:22 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-d45a0ba3-67da-4744-97c3-52fe9ae88925 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Deleted volume successfully. Apr 27 10:05:22 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d45a0ba3-67da-4744-97c3-52fe9ae88925 tempest-VolumeSnapshotQuotasNegativeTestJSON-1081100419 None] Lock "cinder-6cdbc2b2-8cc3-4583-92b8-6012f94daac7-delete_volume" released by "delete_volume" :: held 3.632s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:05:24 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:05:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Flow 'volume_create_manager' (0204d454-5fa3-4b36-9333-b46f411984ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:05:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c2e8b4-3116-40a0-a196-fc4f03b4e731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c2e8b4-3116-40a0-a196-fc4f03b4e731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-472449299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48fb3675-3251-49fb-8db2-c2580f23a50a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffdd368e6cda4f3cb0dda5fe09697267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:05:25Z,use_quota=True,user_id='59066e3392db44e5852ae633ed7d4fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66995a8c-88ed-40d6-ac42-3d95c0470c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66995a8c-88ed-40d6-ac42-3d95c0470c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff819372-6836-41f1-9b67-f4b1a477321b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff819372-6836-41f1-9b67-f4b1a477321b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48fb3675-3251-49fb-8db2-c2580f23a50a', 'volume_name': 'volume-48fb3675-3251-49fb-8db2-c2580f23a50a', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65e34dd-8415-48d0-978f-e22050ea2715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65e34dd-8415-48d0-978f-e22050ea2715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf60d37f-574c-434b-890e-85db9d0407ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:25 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Volume 48fb3675-3251-49fb-8db2-c2580f23a50a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48fb3675-3251-49fb-8db2-c2580f23a50a', 'volume_size': 1} Apr 27 10:05:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:05:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:05:25 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-472449299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48fb3675-3251-49fb-8db2-c2580f23a50a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffdd368e6cda4f3cb0dda5fe09697267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:05:25Z,use_quota=True,user_id='59066e3392db44e5852ae633ed7d4fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:05:25 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Creating volume 48fb3675-3251-49fb-8db2-c2580f23a50a {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:05:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:05:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:05:25 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:05:25 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:05:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:05:25 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:05:25 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:05:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-48fb3675-3251-49fb-8db2-c2580f23a50a 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:25 devstack sudo[82472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-48fb3675-3251-49fb-8db2-c2580f23a50a 1073741824 Apr 27 10:05:25 devstack sudo[82472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:25 devstack sudo[82472]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-48fb3675-3251-49fb-8db2-c2580f23a50a 1073741824" returned: 0 in 0.845s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-48fb3675-3251-49fb-8db2-c2580f23a50a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:26 devstack sudo[82479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-48fb3675-3251-49fb-8db2-c2580f23a50a Apr 27 10:05:26 devstack sudo[82479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:26 devstack sudo[82479]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-48fb3675-3251-49fb-8db2-c2580f23a50a" returned: 0 in 0.554s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:05:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:05:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf60d37f-574c-434b-890e-85db9d0407ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48fb3675-3251-49fb-8db2-c2580f23a50a', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94dd11d0-0580-4a52-b0e8-c285afd4f013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:26 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Volume volume-48fb3675-3251-49fb-8db2-c2580f23a50a (48fb3675-3251-49fb-8db2-c2580f23a50a): created successfully Apr 27 10:05:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94dd11d0-0580-4a52-b0e8-c285afd4f013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Flow 'volume_create_manager' (0204d454-5fa3-4b36-9333-b46f411984ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:05:26 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-c224d8c8-0157-445f-89f9-d34af8a85934 tempest-DeleteServersTestJSON-334207520 None] Created volume successfully. Apr 27 10:05:32 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:05:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Flow 'volume_create_manager' (295d9043-b039-4795-a51b-586abfe8b7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:05:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c26c0b-f057-4edf-a77d-22ef9f63efc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c26c0b-f057-4edf-a77d-22ef9f63efc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1248748337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83edd0aa-c35f-4d72-8672-c6fc78e15a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f63b9c564847d5954c8951431bd32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:05:32Z,use_quota=True,user_id='33c7272cd4954451817870497645f9f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9988c5-a316-49a0-8f75-6aedb0d60a62),volume_type_id=af9988c5-a316-49a0-8f75-6aedb0d60a62)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a72fe80a-589c-4241-b685-6c6c96f75d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a72fe80a-589c-4241-b685-6c6c96f75d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa7c626-6ff2-481e-8c8a-7c3a09f47d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa7c626-6ff2-481e-8c8a-7c3a09f47d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83edd0aa-c35f-4d72-8672-c6fc78e15a85', 'volume_name': 'volume-83edd0aa-c35f-4d72-8672-c6fc78e15a85', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af93d3a-17d0-4a47-b74f-9f6a344025d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af93d3a-17d0-4a47-b74f-9f6a344025d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8db2fe-8d5e-4ffb-96c6-a8dd3f4ae320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:32 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Volume 83edd0aa-c35f-4d72-8672-c6fc78e15a85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83edd0aa-c35f-4d72-8672-c6fc78e15a85', 'volume_size': 1} Apr 27 10:05:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:05:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:05:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1248748337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83edd0aa-c35f-4d72-8672-c6fc78e15a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f63b9c564847d5954c8951431bd32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:05:32Z,use_quota=True,user_id='33c7272cd4954451817870497645f9f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9988c5-a316-49a0-8f75-6aedb0d60a62),volume_type_id=af9988c5-a316-49a0-8f75-6aedb0d60a62)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:05:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Creating volume 83edd0aa-c35f-4d72-8672-c6fc78e15a85 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:05:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:05:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:05:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:05:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:05:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:05:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:05:32 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:05:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-83edd0aa-c35f-4d72-8672-c6fc78e15a85 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:32 devstack sudo[82528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-83edd0aa-c35f-4d72-8672-c6fc78e15a85 1073741824 Apr 27 10:05:32 devstack sudo[82528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:33 devstack sudo[82528]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-83edd0aa-c35f-4d72-8672-c6fc78e15a85 1073741824" returned: 0 in 1.135s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-83edd0aa-c35f-4d72-8672-c6fc78e15a85 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:33 devstack sudo[82564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-83edd0aa-c35f-4d72-8672-c6fc78e15a85 Apr 27 10:05:33 devstack sudo[82564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:33 devstack cinder-volume[81350]: WARNING py.warnings [req-4fad0c92-3f23-4cd3-9d51-d8e401e27b7a req-2ad2d69b-c50b-43c9-ad21-c5cdf85de25c tempest-DeleteServersTestJSON-334207520 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Apr 27 10:05:33 devstack cinder-volume[81350]: .first() Apr 27 10:05:33 devstack cinder-volume[81350]: Apr 27 10:05:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-4fad0c92-3f23-4cd3-9d51-d8e401e27b7a req-2ad2d69b-c50b-43c9-ad21-c5cdf85de25c tempest-DeleteServersTestJSON-334207520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:05:33 devstack sudo[82564]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-83edd0aa-c35f-4d72-8672-c6fc78e15a85" returned: 0 in 0.521s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:33 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:05:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:05:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-4fad0c92-3f23-4cd3-9d51-d8e401e27b7a req-2ad2d69b-c50b-43c9-ad21-c5cdf85de25c tempest-DeleteServersTestJSON-334207520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.134s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:05:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8db2fe-8d5e-4ffb-96c6-a8dd3f4ae320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83edd0aa-c35f-4d72-8672-c6fc78e15a85', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c390b34d-4a63-4f9f-b562-81d427d4fee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:33 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a6e1c3-f4c9-416d-89c4-989d3cb17605]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:05:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-4fad0c92-3f23-4cd3-9d51-d8e401e27b7a req-2ad2d69b-c50b-43c9-ad21-c5cdf85de25c tempest-DeleteServersTestJSON-334207520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-48fb3675-3251-49fb-8db2-c2580f23a50a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:33 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Volume volume-83edd0aa-c35f-4d72-8672-c6fc78e15a85 (83edd0aa-c35f-4d72-8672-c6fc78e15a85): created successfully Apr 27 10:05:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c390b34d-4a63-4f9f-b562-81d427d4fee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Flow 'volume_create_manager' (295d9043-b039-4795-a51b-586abfe8b7c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:05:33 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-c989636d-2106-44fd-b091-5941483ec5f3 tempest-VolumeTypesAccessTest-906381672 None] Created volume successfully. Apr 27 10:05:34 devstack sudo[82581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-48fb3675-3251-49fb-8db2-c2580f23a50a Apr 27 10:05:34 devstack sudo[82581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:34 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c1a74441-f663-4390-b829-f1e20b8794ed tempest-VolumeTypesAccessTest-906381672 None] Acquiring lock "cinder-83edd0aa-c35f-4d72-8672-c6fc78e15a85-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:05:34 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c1a74441-f663-4390-b829-f1e20b8794ed tempest-VolumeTypesAccessTest-906381672 None] Lock "cinder-83edd0aa-c35f-4d72-8672-c6fc78e15a85-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:05:34 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c1a74441-f663-4390-b829-f1e20b8794ed tempest-VolumeTypesAccessTest-906381672 None] Acquiring lock "cinder-quobyte-83edd0aa-c35f-4d72-8672-c6fc78e15a85" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:05:34 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c1a74441-f663-4390-b829-f1e20b8794ed tempest-VolumeTypesAccessTest-906381672 None] Lock "cinder-quobyte-83edd0aa-c35f-4d72-8672-c6fc78e15a85" acquired by "delete_volume" :: waited 0.017s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:05:34 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[43beb83b-3988-4b19-92b6-e93599ade0cd]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:05:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c1a74441-f663-4390-b829-f1e20b8794ed tempest-VolumeTypesAccessTest-906381672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-83edd0aa-c35f-4d72-8672-c6fc78e15a85 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:34 devstack sudo[82581]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-4fad0c92-3f23-4cd3-9d51-d8e401e27b7a req-2ad2d69b-c50b-43c9-ad21-c5cdf85de25c tempest-DeleteServersTestJSON-334207520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-48fb3675-3251-49fb-8db2-c2580f23a50a" returned: 0 in 0.678s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-4fad0c92-3f23-4cd3-9d51-d8e401e27b7a req-2ad2d69b-c50b-43c9-ad21-c5cdf85de25c tempest-DeleteServersTestJSON-334207520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.714s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:05:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-4fad0c92-3f23-4cd3-9d51-d8e401e27b7a req-2ad2d69b-c50b-43c9-ad21-c5cdf85de25c tempest-DeleteServersTestJSON-334207520 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4', 'name': 'volume-48fb3675-3251-49fb-8db2-c2580f23a50a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ede6872-a62d-4d5d-b0ef-1be59efc7f4d', 'enforce_multipath': True} {{(pid=81350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 27 10:05:34 devstack sudo[82595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-83edd0aa-c35f-4d72-8672-c6fc78e15a85 Apr 27 10:05:34 devstack sudo[82595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:34 devstack cinder-volume[81350]: INFO cinder.volume.manager [req-4fad0c92-3f23-4cd3-9d51-d8e401e27b7a req-2ad2d69b-c50b-43c9-ad21-c5cdf85de25c tempest-DeleteServersTestJSON-334207520 None] attachment_update completed successfully. Apr 27 10:05:35 devstack sudo[82595]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c1a74441-f663-4390-b829-f1e20b8794ed tempest-VolumeTypesAccessTest-906381672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-83edd0aa-c35f-4d72-8672-c6fc78e15a85" returned: 0 in 0.663s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c1a74441-f663-4390-b829-f1e20b8794ed tempest-VolumeTypesAccessTest-906381672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-83edd0aa-c35f-4d72-8672-c6fc78e15a85 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:35 devstack sudo[82619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-83edd0aa-c35f-4d72-8672-c6fc78e15a85 Apr 27 10:05:35 devstack sudo[82619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:35 devstack sudo[82619]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c1a74441-f663-4390-b829-f1e20b8794ed tempest-VolumeTypesAccessTest-906381672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-83edd0aa-c35f-4d72-8672-c6fc78e15a85" returned: 0 in 0.619s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c1a74441-f663-4390-b829-f1e20b8794ed tempest-VolumeTypesAccessTest-906381672 None] Lock "cinder-quobyte-83edd0aa-c35f-4d72-8672-c6fc78e15a85" released by "delete_volume" :: held 1.338s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:05:35 devstack cinder-volume[81350]: WARNING cinder.quota [None req-c1a74441-f663-4390-b829-f1e20b8794ed tempest-VolumeTypesAccessTest-906381672 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1202481631 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1202481631, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:05:35 devstack cinder-volume[81350]: WARNING cinder.quota [None req-c1a74441-f663-4390-b829-f1e20b8794ed tempest-VolumeTypesAccessTest-906381672 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1202481631 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1202481631, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:05:35 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-c1a74441-f663-4390-b829-f1e20b8794ed tempest-VolumeTypesAccessTest-906381672 None] Created reservations ['699d6d6a-cedc-4c6a-97f2-65567dd39d49', 'd5b4f9cf-c315-4421-80d6-d3989b2f404f', '10745982-2608-4e1f-ad62-9abb1d3b53a0', 'f8acab5b-7305-4fe8-af50-4fe5ff733b58'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:05:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c1a74441-f663-4390-b829-f1e20b8794ed tempest-VolumeTypesAccessTest-906381672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:05:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c1a74441-f663-4390-b829-f1e20b8794ed tempest-VolumeTypesAccessTest-906381672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:05:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c1a74441-f663-4390-b829-f1e20b8794ed tempest-VolumeTypesAccessTest-906381672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:05:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c1a74441-f663-4390-b829-f1e20b8794ed tempest-VolumeTypesAccessTest-906381672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:05:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c1a74441-f663-4390-b829-f1e20b8794ed tempest-VolumeTypesAccessTest-906381672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:05:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c1a74441-f663-4390-b829-f1e20b8794ed tempest-VolumeTypesAccessTest-906381672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:36 devstack sudo[82704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:05:36 devstack sudo[82704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:36 devstack sudo[82704]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c1a74441-f663-4390-b829-f1e20b8794ed tempest-VolumeTypesAccessTest-906381672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.583s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:36 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-c1a74441-f663-4390-b829-f1e20b8794ed tempest-VolumeTypesAccessTest-906381672 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:05:36 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-c1a74441-f663-4390-b829-f1e20b8794ed tempest-VolumeTypesAccessTest-906381672 None] Deleted volume successfully. Apr 27 10:05:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c1a74441-f663-4390-b829-f1e20b8794ed tempest-VolumeTypesAccessTest-906381672 None] Lock "cinder-83edd0aa-c35f-4d72-8672-c6fc78e15a85-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:05:44 devstack cinder-volume[81350]: INFO cinder.volume.manager [req-7fb616ba-55b2-4087-b027-0352db4dc569 req-5dea741b-6195-4e1c-9271-01d35ab19792 tempest-DeleteServersTestJSON-334207520 None] Terminate volume connection completed successfully. Apr 27 10:05:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-7fb616ba-55b2-4087-b027-0352db4dc569 req-5dea741b-6195-4e1c-9271-01d35ab19792 tempest-DeleteServersTestJSON-334207520 None] Deleting attachment 0ede6872-a62d-4d5d-b0ef-1be59efc7f4d. {{(pid=81350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 27 10:05:46 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:05:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Flow 'volume_create_manager' (6701c8da-c1e6-4032-b258-50bb8193411d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:05:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c087a7-4b04-41bd-9700-879052963a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c087a7-4b04-41bd-9700-879052963a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-160812858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0530b76c-2f31-456d-8bab-c92192df777d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c82a782607493ca23b1b5ea8382606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:05:46Z,use_quota=True,user_id='1d08d703ab4d4afbbb4381f15dec335a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (640a9100-1478-40e9-988d-fe0386eb39ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (640a9100-1478-40e9-988d-fe0386eb39ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67408fcf-a7a5-4de4-b55c-c653a9b6926a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67408fcf-a7a5-4de4-b55c-c653a9b6926a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0530b76c-2f31-456d-8bab-c92192df777d', 'volume_name': 'volume-0530b76c-2f31-456d-8bab-c92192df777d', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a9ac33-969e-4058-ab47-14cbbddee2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a9ac33-969e-4058-ab47-14cbbddee2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c56bb1a-80ce-4f03-af80-464e5fc57cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:46 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Volume 0530b76c-2f31-456d-8bab-c92192df777d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0530b76c-2f31-456d-8bab-c92192df777d', 'volume_size': 1} Apr 27 10:05:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:05:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:05:46 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-160812858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0530b76c-2f31-456d-8bab-c92192df777d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c82a782607493ca23b1b5ea8382606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:05:46Z,use_quota=True,user_id='1d08d703ab4d4afbbb4381f15dec335a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:05:46 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Creating volume 0530b76c-2f31-456d-8bab-c92192df777d {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:05:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:05:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:05:46 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:05:46 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:05:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:05:46 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:05:46 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:05:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:46 devstack sudo[83098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d 1073741824 Apr 27 10:05:46 devstack sudo[83098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:47 devstack sudo[83098]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d 1073741824" returned: 0 in 0.717s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:47 devstack sudo[83105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d Apr 27 10:05:47 devstack sudo[83105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:48 devstack sudo[83105]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d" returned: 0 in 0.717s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:05:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:05:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c56bb1a-80ce-4f03-af80-464e5fc57cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0530b76c-2f31-456d-8bab-c92192df777d', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02db6c4-27c9-4d39-aea6-49da20a58635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:48 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Volume volume-0530b76c-2f31-456d-8bab-c92192df777d (0530b76c-2f31-456d-8bab-c92192df777d): created successfully Apr 27 10:05:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02db6c4-27c9-4d39-aea6-49da20a58635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Flow 'volume_create_manager' (6701c8da-c1e6-4032-b258-50bb8193411d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:05:48 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-5033f486-f485-4b32-8eb9-0e270a78114a tempest-SnapshotMetadataTestJSON-1255237208 None] Created volume successfully. Apr 27 10:05:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b5a7ca69-89c0-4788-8c0e-866f50f55875 tempest-DeleteServersTestJSON-334207520 None] Acquiring lock "cinder-48fb3675-3251-49fb-8db2-c2580f23a50a-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:05:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b5a7ca69-89c0-4788-8c0e-866f50f55875 tempest-DeleteServersTestJSON-334207520 None] Lock "cinder-48fb3675-3251-49fb-8db2-c2580f23a50a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:05:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b5a7ca69-89c0-4788-8c0e-866f50f55875 tempest-DeleteServersTestJSON-334207520 None] Acquiring lock "cinder-quobyte-48fb3675-3251-49fb-8db2-c2580f23a50a" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:05:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b5a7ca69-89c0-4788-8c0e-866f50f55875 tempest-DeleteServersTestJSON-334207520 None] Lock "cinder-quobyte-48fb3675-3251-49fb-8db2-c2580f23a50a" acquired by "delete_volume" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:05:48 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a5b114-690a-47c0-b34c-42c9d76d8a29]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:05:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b5a7ca69-89c0-4788-8c0e-866f50f55875 tempest-DeleteServersTestJSON-334207520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-48fb3675-3251-49fb-8db2-c2580f23a50a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f1f1f542-8cf4-4307-bde1-0b79e88b9fa8 tempest-SnapshotMetadataTestJSON-1255237208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:05:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f1f1f542-8cf4-4307-bde1-0b79e88b9fa8 tempest-SnapshotMetadataTestJSON-1255237208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:05:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-f1f1f542-8cf4-4307-bde1-0b79e88b9fa8 tempest-SnapshotMetadataTestJSON-1255237208 None] Creating offline snapshot 76134875-3aaf-4aa8-85ab-eae5d20f4461 of volume 0530b76c-2f31-456d-8bab-c92192df777d {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:05:48 devstack sudo[83110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-48fb3675-3251-49fb-8db2-c2580f23a50a Apr 27 10:05:48 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dcf1bc-edaf-46b8-a504-2f73f94746a7]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:05:48 devstack sudo[83110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f1f1f542-8cf4-4307-bde1-0b79e88b9fa8 tempest-SnapshotMetadataTestJSON-1255237208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:48 devstack sudo[83112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d Apr 27 10:05:48 devstack sudo[83112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:49 devstack sudo[83110]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b5a7ca69-89c0-4788-8c0e-866f50f55875 tempest-DeleteServersTestJSON-334207520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-48fb3675-3251-49fb-8db2-c2580f23a50a" returned: 0 in 0.632s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b5a7ca69-89c0-4788-8c0e-866f50f55875 tempest-DeleteServersTestJSON-334207520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-48fb3675-3251-49fb-8db2-c2580f23a50a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:49 devstack sudo[83117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-48fb3675-3251-49fb-8db2-c2580f23a50a Apr 27 10:05:49 devstack sudo[83117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:49 devstack sudo[83112]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f1f1f542-8cf4-4307-bde1-0b79e88b9fa8 tempest-SnapshotMetadataTestJSON-1255237208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d" returned: 0 in 0.692s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f1f1f542-8cf4-4307-bde1-0b79e88b9fa8 tempest-SnapshotMetadataTestJSON-1255237208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.76134875-3aaf-4aa8-85ab-eae5d20f4461 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:49 devstack sudo[83124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.76134875-3aaf-4aa8-85ab-eae5d20f4461 1G Apr 27 10:05:49 devstack sudo[83124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:50 devstack sudo[83117]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b5a7ca69-89c0-4788-8c0e-866f50f55875 tempest-DeleteServersTestJSON-334207520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-48fb3675-3251-49fb-8db2-c2580f23a50a" returned: 0 in 0.665s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:50 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b5a7ca69-89c0-4788-8c0e-866f50f55875 tempest-DeleteServersTestJSON-334207520 None] Lock "cinder-quobyte-48fb3675-3251-49fb-8db2-c2580f23a50a" released by "delete_volume" :: held 1.356s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:05:50 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-b5a7ca69-89c0-4788-8c0e-866f50f55875 tempest-DeleteServersTestJSON-334207520 None] Created reservations ['ea53b296-ead9-4dc8-ab83-eb15d1107790', '879d7007-2f14-4257-af67-63a5b59168ba', 'ed1bc0fb-eedf-44e5-b523-cb7fee604255', '855285fc-1a6a-4826-a481-016f4d9ce457'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:05:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b5a7ca69-89c0-4788-8c0e-866f50f55875 tempest-DeleteServersTestJSON-334207520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:05:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b5a7ca69-89c0-4788-8c0e-866f50f55875 tempest-DeleteServersTestJSON-334207520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:05:50 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b5a7ca69-89c0-4788-8c0e-866f50f55875 tempest-DeleteServersTestJSON-334207520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:05:50 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b5a7ca69-89c0-4788-8c0e-866f50f55875 tempest-DeleteServersTestJSON-334207520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:05:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b5a7ca69-89c0-4788-8c0e-866f50f55875 tempest-DeleteServersTestJSON-334207520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:05:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b5a7ca69-89c0-4788-8c0e-866f50f55875 tempest-DeleteServersTestJSON-334207520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:50 devstack sudo[83131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:05:50 devstack sudo[83131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:50 devstack sudo[83124]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f1f1f542-8cf4-4307-bde1-0b79e88b9fa8 tempest-SnapshotMetadataTestJSON-1255237208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.76134875-3aaf-4aa8-85ab-eae5d20f4461 1G" returned: 0 in 1.072s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f1f1f542-8cf4-4307-bde1-0b79e88b9fa8 tempest-SnapshotMetadataTestJSON-1255237208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0530b76c-2f31-456d-8bab-c92192df777d -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.76134875-3aaf-4aa8-85ab-eae5d20f4461 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:50 devstack sudo[83133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0530b76c-2f31-456d-8bab-c92192df777d -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.76134875-3aaf-4aa8-85ab-eae5d20f4461 Apr 27 10:05:50 devstack sudo[83133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:51 devstack sudo[83131]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b5a7ca69-89c0-4788-8c0e-866f50f55875 tempest-DeleteServersTestJSON-334207520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.888s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:51 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-b5a7ca69-89c0-4788-8c0e-866f50f55875 tempest-DeleteServersTestJSON-334207520 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:05:51 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-b5a7ca69-89c0-4788-8c0e-866f50f55875 tempest-DeleteServersTestJSON-334207520 None] Deleted volume successfully. Apr 27 10:05:51 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b5a7ca69-89c0-4788-8c0e-866f50f55875 tempest-DeleteServersTestJSON-334207520 None] Lock "cinder-48fb3675-3251-49fb-8db2-c2580f23a50a-delete_volume" released by "delete_volume" :: held 2.534s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:05:51 devstack sudo[83133]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f1f1f542-8cf4-4307-bde1-0b79e88b9fa8 tempest-SnapshotMetadataTestJSON-1255237208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0530b76c-2f31-456d-8bab-c92192df777d -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.76134875-3aaf-4aa8-85ab-eae5d20f4461" returned: 0 in 1.137s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:51 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-f1f1f542-8cf4-4307-bde1-0b79e88b9fa8 tempest-SnapshotMetadataTestJSON-1255237208 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.76134875-3aaf-4aa8-85ab-eae5d20f4461 is being set with open permissions: ugo+rw Apr 27 10:05:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f1f1f542-8cf4-4307-bde1-0b79e88b9fa8 tempest-SnapshotMetadataTestJSON-1255237208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.76134875-3aaf-4aa8-85ab-eae5d20f4461 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:51 devstack sudo[83139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.76134875-3aaf-4aa8-85ab-eae5d20f4461 Apr 27 10:05:51 devstack sudo[83139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:52 devstack sudo[83139]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f1f1f542-8cf4-4307-bde1-0b79e88b9fa8 tempest-SnapshotMetadataTestJSON-1255237208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.76134875-3aaf-4aa8-85ab-eae5d20f4461" returned: 0 in 0.859s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:52 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:SELECT=48,cinder:UPDATE=60,cinder:INSERT=14,cinder:DELETE=4 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:05:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f1f1f542-8cf4-4307-bde1-0b79e88b9fa8 tempest-SnapshotMetadataTestJSON-1255237208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:52 devstack sudo[83176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.info Apr 27 10:05:52 devstack sudo[83176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:53 devstack sudo[83176]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f1f1f542-8cf4-4307-bde1-0b79e88b9fa8 tempest-SnapshotMetadataTestJSON-1255237208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.info" returned: 0 in 0.599s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:53 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-f1f1f542-8cf4-4307-bde1-0b79e88b9fa8 tempest-SnapshotMetadataTestJSON-1255237208 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.info is being set with open permissions: ugo+rw Apr 27 10:05:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f1f1f542-8cf4-4307-bde1-0b79e88b9fa8 tempest-SnapshotMetadataTestJSON-1255237208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:53 devstack sudo[83179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.info Apr 27 10:05:53 devstack sudo[83179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:54 devstack sudo[83179]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f1f1f542-8cf4-4307-bde1-0b79e88b9fa8 tempest-SnapshotMetadataTestJSON-1255237208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.info" returned: 0 in 0.745s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f1f1f542-8cf4-4307-bde1-0b79e88b9fa8 tempest-SnapshotMetadataTestJSON-1255237208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.280s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:05:54 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-f1f1f542-8cf4-4307-bde1-0b79e88b9fa8 tempest-SnapshotMetadataTestJSON-1255237208 None] Create snapshot completed successfully Apr 27 10:05:55 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:05:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Flow 'volume_create_manager' (68fd6bce-09c3-4284-8b92-481f250725f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:05:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b3a18e1-60f1-4e71-bb5f-e197ebc423d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b3a18e1-60f1-4e71-bb5f-e197ebc423d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-231675206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3eadc5-7a7b-4015-9d6f-28d201b21e67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7f9d09201242ea934f8d37bfcfa73b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:05:56Z,use_quota=True,user_id='323a68c84b9a47339a4abbe71db4ff20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad663f3a-9fb8-47d8-a05e-af378dc0967e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad663f3a-9fb8-47d8-a05e-af378dc0967e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daf774d6-74eb-439e-aa07-5780bb84d70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daf774d6-74eb-439e-aa07-5780bb84d70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd3eadc5-7a7b-4015-9d6f-28d201b21e67', 'volume_name': 'volume-cd3eadc5-7a7b-4015-9d6f-28d201b21e67', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a80a4ac5-a892-49cb-a882-0e9480367bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a80a4ac5-a892-49cb-a882-0e9480367bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56df10be-917a-4c97-8ed5-46d0b4b82d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:55 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Volume cd3eadc5-7a7b-4015-9d6f-28d201b21e67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd3eadc5-7a7b-4015-9d6f-28d201b21e67', 'volume_size': 1} Apr 27 10:05:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:05:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:05:55 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-231675206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3eadc5-7a7b-4015-9d6f-28d201b21e67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7f9d09201242ea934f8d37bfcfa73b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:05:56Z,use_quota=True,user_id='323a68c84b9a47339a4abbe71db4ff20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:05:55 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Creating volume cd3eadc5-7a7b-4015-9d6f-28d201b21e67 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:05:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:05:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:05:55 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:05:55 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:05:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:05:55 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:05:55 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:05:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cd3eadc5-7a7b-4015-9d6f-28d201b21e67 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:55 devstack sudo[83184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cd3eadc5-7a7b-4015-9d6f-28d201b21e67 1073741824 Apr 27 10:05:55 devstack sudo[83184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:56 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a525e222-20a3-4ec1-9b27-a13dbffd87be tempest-SnapshotMetadataTestJSON-1255237208 None] Acquiring lock "cinder-76134875-3aaf-4aa8-85ab-eae5d20f4461-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:05:56 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a525e222-20a3-4ec1-9b27-a13dbffd87be tempest-SnapshotMetadataTestJSON-1255237208 None] Lock "cinder-76134875-3aaf-4aa8-85ab-eae5d20f4461-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:05:56 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a525e222-20a3-4ec1-9b27-a13dbffd87be tempest-SnapshotMetadataTestJSON-1255237208 None] Acquiring lock "cinder-quobyte-0530b76c-2f31-456d-8bab-c92192df777d" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:05:56 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a525e222-20a3-4ec1-9b27-a13dbffd87be tempest-SnapshotMetadataTestJSON-1255237208 None] Lock "cinder-quobyte-0530b76c-2f31-456d-8bab-c92192df777d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:05:56 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a525e222-20a3-4ec1-9b27-a13dbffd87be tempest-SnapshotMetadataTestJSON-1255237208 None] Acquiring lock "cinder-quobyte-76134875-3aaf-4aa8-85ab-eae5d20f4461" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:05:56 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a525e222-20a3-4ec1-9b27-a13dbffd87be tempest-SnapshotMetadataTestJSON-1255237208 None] Lock "cinder-quobyte-76134875-3aaf-4aa8-85ab-eae5d20f4461" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:05:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-a525e222-20a3-4ec1-9b27-a13dbffd87be tempest-SnapshotMetadataTestJSON-1255237208 None] Deleting offline snapshot 76134875-3aaf-4aa8-85ab-eae5d20f4461 of volume 0530b76c-2f31-456d-8bab-c92192df777d {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:05:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-a525e222-20a3-4ec1-9b27-a13dbffd87be tempest-SnapshotMetadataTestJSON-1255237208 None] snapshot_file for this snap is: volume-0530b76c-2f31-456d-8bab-c92192df777d.76134875-3aaf-4aa8-85ab-eae5d20f4461 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:05:56 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fb7d62-eb63-4fdb-8f20-8e504bac7938]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:05:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a525e222-20a3-4ec1-9b27-a13dbffd87be tempest-SnapshotMetadataTestJSON-1255237208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.76134875-3aaf-4aa8-85ab-eae5d20f4461 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:56 devstack sudo[83186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.76134875-3aaf-4aa8-85ab-eae5d20f4461 Apr 27 10:05:56 devstack sudo[83186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:57 devstack sudo[83184]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cd3eadc5-7a7b-4015-9d6f-28d201b21e67 1073741824" returned: 0 in 1.246s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cd3eadc5-7a7b-4015-9d6f-28d201b21e67 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:57 devstack sudo[83194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cd3eadc5-7a7b-4015-9d6f-28d201b21e67 Apr 27 10:05:57 devstack sudo[83194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:57 devstack sudo[83186]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a525e222-20a3-4ec1-9b27-a13dbffd87be tempest-SnapshotMetadataTestJSON-1255237208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.76134875-3aaf-4aa8-85ab-eae5d20f4461" returned: 0 in 1.153s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-a525e222-20a3-4ec1-9b27-a13dbffd87be tempest-SnapshotMetadataTestJSON-1255237208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0530b76c-2f31-456d-8bab-c92192df777d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:05:57 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e055fa41-795b-434c-a591-7ba43f6be88a]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:05:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a525e222-20a3-4ec1-9b27-a13dbffd87be tempest-SnapshotMetadataTestJSON-1255237208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:57 devstack sudo[83200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d Apr 27 10:05:58 devstack sudo[83200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:05:58 devstack sudo[83194]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cd3eadc5-7a7b-4015-9d6f-28d201b21e67" returned: 0 in 1.060s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:58 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] <== create_volume: return (2367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:05:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.371s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:05:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56df10be-917a-4c97-8ed5-46d0b4b82d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd3eadc5-7a7b-4015-9d6f-28d201b21e67', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c752f530-50c2-466a-bc63-f59814b35872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:05:58 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Volume volume-cd3eadc5-7a7b-4015-9d6f-28d201b21e67 (cd3eadc5-7a7b-4015-9d6f-28d201b21e67): created successfully Apr 27 10:05:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c752f530-50c2-466a-bc63-f59814b35872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:05:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Flow 'volume_create_manager' (68fd6bce-09c3-4284-8b92-481f250725f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:05:58 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-7bd08fc9-43ab-4e7e-b22f-f857867869c2 tempest-VolumesAdminNegativeTest-969411805 None] Created volume successfully. Apr 27 10:05:58 devstack sudo[83200]: pam_unix(sudo:session): session closed for user root Apr 27 10:05:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a525e222-20a3-4ec1-9b27-a13dbffd87be tempest-SnapshotMetadataTestJSON-1255237208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d" returned: 0 in 1.189s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:05:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a525e222-20a3-4ec1-9b27-a13dbffd87be tempest-SnapshotMetadataTestJSON-1255237208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.76134875-3aaf-4aa8-85ab-eae5d20f4461 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:05:59 devstack sudo[83209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.76134875-3aaf-4aa8-85ab-eae5d20f4461 Apr 27 10:05:59 devstack sudo[83209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-95606f19-acd1-4950-b58c-15713bed6109 tempest-VolumesAdminNegativeTest-969411805 None] Acquiring lock "cinder-cd3eadc5-7a7b-4015-9d6f-28d201b21e67-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:06:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-95606f19-acd1-4950-b58c-15713bed6109 tempest-VolumesAdminNegativeTest-969411805 None] Lock "cinder-cd3eadc5-7a7b-4015-9d6f-28d201b21e67-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:06:00 devstack sudo[83209]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a525e222-20a3-4ec1-9b27-a13dbffd87be tempest-SnapshotMetadataTestJSON-1255237208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.76134875-3aaf-4aa8-85ab-eae5d20f4461" returned: 0 in 1.356s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a525e222-20a3-4ec1-9b27-a13dbffd87be tempest-SnapshotMetadataTestJSON-1255237208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.76134875-3aaf-4aa8-85ab-eae5d20f4461 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-95606f19-acd1-4950-b58c-15713bed6109 tempest-VolumesAdminNegativeTest-969411805 None] Acquiring lock "cinder-quobyte-cd3eadc5-7a7b-4015-9d6f-28d201b21e67" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:06:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-95606f19-acd1-4950-b58c-15713bed6109 tempest-VolumesAdminNegativeTest-969411805 None] Lock "cinder-quobyte-cd3eadc5-7a7b-4015-9d6f-28d201b21e67" acquired by "delete_volume" :: waited 0.032s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:06:00 devstack sudo[83223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.76134875-3aaf-4aa8-85ab-eae5d20f4461 Apr 27 10:06:00 devstack sudo[83223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:00 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[024a3331-82b0-44d5-b41f-62c9ad4b5386]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:06:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-95606f19-acd1-4950-b58c-15713bed6109 tempest-VolumesAdminNegativeTest-969411805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cd3eadc5-7a7b-4015-9d6f-28d201b21e67 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:00 devstack sudo[83225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cd3eadc5-7a7b-4015-9d6f-28d201b21e67 Apr 27 10:06:00 devstack sudo[83225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:00 devstack sudo[83223]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a525e222-20a3-4ec1-9b27-a13dbffd87be tempest-SnapshotMetadataTestJSON-1255237208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d.76134875-3aaf-4aa8-85ab-eae5d20f4461" returned: 0 in 0.548s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a525e222-20a3-4ec1-9b27-a13dbffd87be tempest-SnapshotMetadataTestJSON-1255237208 None] Lock "cinder-quobyte-76134875-3aaf-4aa8-85ab-eae5d20f4461" released by "_delete_snapshot" :: held 4.396s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:06:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a525e222-20a3-4ec1-9b27-a13dbffd87be tempest-SnapshotMetadataTestJSON-1255237208 None] Lock "cinder-quobyte-0530b76c-2f31-456d-8bab-c92192df777d" released by "delete_snapshot" :: held 4.433s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:06:01 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-a525e222-20a3-4ec1-9b27-a13dbffd87be tempest-SnapshotMetadataTestJSON-1255237208 None] Created reservations ['77be8eec-3cd8-4d18-ae07-6d66beac4fa7', '8badb303-dfb9-4c85-9134-c480ae69134b', 'b9c14246-963e-4c70-b7ed-eaa80456a15c', 'd8315d23-91b6-42f3-a31f-ac632c00aacf'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:06:01 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:UPDATE=39,cinder:SELECT=46,cinder:INSERT=8,cinder:DELETE=6 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:06:01 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-a525e222-20a3-4ec1-9b27-a13dbffd87be tempest-SnapshotMetadataTestJSON-1255237208 None] Delete snapshot completed successfully. Apr 27 10:06:01 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a525e222-20a3-4ec1-9b27-a13dbffd87be tempest-SnapshotMetadataTestJSON-1255237208 None] Lock "cinder-76134875-3aaf-4aa8-85ab-eae5d20f4461-delete_snapshot" released by "delete_snapshot" :: held 4.661s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:06:01 devstack sudo[83225]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-95606f19-acd1-4950-b58c-15713bed6109 tempest-VolumesAdminNegativeTest-969411805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cd3eadc5-7a7b-4015-9d6f-28d201b21e67" returned: 0 in 0.803s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-95606f19-acd1-4950-b58c-15713bed6109 tempest-VolumesAdminNegativeTest-969411805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cd3eadc5-7a7b-4015-9d6f-28d201b21e67 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:01 devstack sudo[83260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cd3eadc5-7a7b-4015-9d6f-28d201b21e67 Apr 27 10:06:01 devstack sudo[83260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:01 devstack sudo[83260]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-95606f19-acd1-4950-b58c-15713bed6109 tempest-VolumesAdminNegativeTest-969411805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cd3eadc5-7a7b-4015-9d6f-28d201b21e67" returned: 0 in 0.648s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:01 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-95606f19-acd1-4950-b58c-15713bed6109 tempest-VolumesAdminNegativeTest-969411805 None] Lock "cinder-quobyte-cd3eadc5-7a7b-4015-9d6f-28d201b21e67" released by "delete_volume" :: held 1.538s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:06:02 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-95606f19-acd1-4950-b58c-15713bed6109 tempest-VolumesAdminNegativeTest-969411805 None] Created reservations ['6b293fee-7992-49db-bb27-22780f441ffa', '8fd5cdf3-239d-4856-a2c7-910ec300c388', '9f397698-c6d3-4207-bee9-09fb2df67dad', '14d79ecb-86a4-4ccf-99ed-822775bc367d'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:06:02 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-4c261c3e-c5a8-4859-9138-b1d112df7a43 tempest-SnapshotMetadataTestJSON-1255237208 None] Acquiring lock "cinder-0530b76c-2f31-456d-8bab-c92192df777d-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:06:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-95606f19-acd1-4950-b58c-15713bed6109 tempest-VolumesAdminNegativeTest-969411805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:06:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-95606f19-acd1-4950-b58c-15713bed6109 tempest-VolumesAdminNegativeTest-969411805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:06:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-95606f19-acd1-4950-b58c-15713bed6109 tempest-VolumesAdminNegativeTest-969411805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:06:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-95606f19-acd1-4950-b58c-15713bed6109 tempest-VolumesAdminNegativeTest-969411805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:06:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-95606f19-acd1-4950-b58c-15713bed6109 tempest-VolumesAdminNegativeTest-969411805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:06:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-95606f19-acd1-4950-b58c-15713bed6109 tempest-VolumesAdminNegativeTest-969411805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:02 devstack sudo[83263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:06:02 devstack sudo[83263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:02 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-4c261c3e-c5a8-4859-9138-b1d112df7a43 tempest-SnapshotMetadataTestJSON-1255237208 None] Lock "cinder-0530b76c-2f31-456d-8bab-c92192df777d-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:06:02 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-4c261c3e-c5a8-4859-9138-b1d112df7a43 tempest-SnapshotMetadataTestJSON-1255237208 None] Acquiring lock "cinder-quobyte-0530b76c-2f31-456d-8bab-c92192df777d" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:06:02 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-4c261c3e-c5a8-4859-9138-b1d112df7a43 tempest-SnapshotMetadataTestJSON-1255237208 None] Lock "cinder-quobyte-0530b76c-2f31-456d-8bab-c92192df777d" acquired by "delete_volume" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:06:02 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[738de252-3f92-4587-8a84-447de6c8ad57]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:06:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-4c261c3e-c5a8-4859-9138-b1d112df7a43 tempest-SnapshotMetadataTestJSON-1255237208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:02 devstack sudo[83265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d Apr 27 10:06:02 devstack sudo[83265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:02 devstack sudo[83263]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-95606f19-acd1-4950-b58c-15713bed6109 tempest-VolumesAdminNegativeTest-969411805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.580s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:02 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-95606f19-acd1-4950-b58c-15713bed6109 tempest-VolumesAdminNegativeTest-969411805 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:06:02 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-95606f19-acd1-4950-b58c-15713bed6109 tempest-VolumesAdminNegativeTest-969411805 None] Deleted volume successfully. Apr 27 10:06:02 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-95606f19-acd1-4950-b58c-15713bed6109 tempest-VolumesAdminNegativeTest-969411805 None] Lock "cinder-cd3eadc5-7a7b-4015-9d6f-28d201b21e67-delete_volume" released by "delete_volume" :: held 2.500s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:06:03 devstack sudo[83265]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-4c261c3e-c5a8-4859-9138-b1d112df7a43 tempest-SnapshotMetadataTestJSON-1255237208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d" returned: 0 in 0.811s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-4c261c3e-c5a8-4859-9138-b1d112df7a43 tempest-SnapshotMetadataTestJSON-1255237208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:03 devstack sudo[83273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d Apr 27 10:06:03 devstack sudo[83273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:03 devstack sudo[83273]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-4c261c3e-c5a8-4859-9138-b1d112df7a43 tempest-SnapshotMetadataTestJSON-1255237208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0530b76c-2f31-456d-8bab-c92192df777d" returned: 0 in 0.605s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:03 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-4c261c3e-c5a8-4859-9138-b1d112df7a43 tempest-SnapshotMetadataTestJSON-1255237208 None] Lock "cinder-quobyte-0530b76c-2f31-456d-8bab-c92192df777d" released by "delete_volume" :: held 1.511s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:06:03 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-4c261c3e-c5a8-4859-9138-b1d112df7a43 tempest-SnapshotMetadataTestJSON-1255237208 None] Created reservations ['9aeb4be4-5436-44db-90c3-e5939cb25c8f', '67ca270c-b8a4-456b-8251-e45a7aae533f', 'cb0c86db-6a7f-4cf3-8bd1-16d7f7dd7d12', '98a231f9-236d-4517-95ad-0360ec8d9cfe'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:06:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-4c261c3e-c5a8-4859-9138-b1d112df7a43 tempest-SnapshotMetadataTestJSON-1255237208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:06:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-4c261c3e-c5a8-4859-9138-b1d112df7a43 tempest-SnapshotMetadataTestJSON-1255237208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:06:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-4c261c3e-c5a8-4859-9138-b1d112df7a43 tempest-SnapshotMetadataTestJSON-1255237208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:06:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-4c261c3e-c5a8-4859-9138-b1d112df7a43 tempest-SnapshotMetadataTestJSON-1255237208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:06:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-4c261c3e-c5a8-4859-9138-b1d112df7a43 tempest-SnapshotMetadataTestJSON-1255237208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:06:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-4c261c3e-c5a8-4859-9138-b1d112df7a43 tempest-SnapshotMetadataTestJSON-1255237208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:04 devstack sudo[83287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:06:04 devstack sudo[83287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:04 devstack sudo[83287]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-4c261c3e-c5a8-4859-9138-b1d112df7a43 tempest-SnapshotMetadataTestJSON-1255237208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.861s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:04 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-4c261c3e-c5a8-4859-9138-b1d112df7a43 tempest-SnapshotMetadataTestJSON-1255237208 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:06:04 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-4c261c3e-c5a8-4859-9138-b1d112df7a43 tempest-SnapshotMetadataTestJSON-1255237208 None] Deleted volume successfully. Apr 27 10:06:04 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-4c261c3e-c5a8-4859-9138-b1d112df7a43 tempest-SnapshotMetadataTestJSON-1255237208 None] Lock "cinder-0530b76c-2f31-456d-8bab-c92192df777d-delete_volume" released by "delete_volume" :: held 2.754s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:06:11 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:06:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Flow 'volume_create_manager' (08ae5e0c-6891-48c7-a299-3291a67598bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:06:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811347d5-ee4a-4b04-8fb6-fcaddf335905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:06:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811347d5-ee4a-4b04-8fb6-fcaddf335905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-28064121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db1a8ad-8a7f-46a5-9e00-54822091ede5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a0e67630a4489ca35da0121c9edd31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:06:11Z,use_quota=True,user_id='e370ed27cbb348a0b5a77da9b477ec37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:06:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8512c57-1d19-4a21-ae88-abd10517fc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:06:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8512c57-1d19-4a21-ae88-abd10517fc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:06:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb3ecf2-a2eb-4db1-a697-28c0012ffd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:06:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb3ecf2-a2eb-4db1-a697-28c0012ffd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6db1a8ad-8a7f-46a5-9e00-54822091ede5', 'volume_name': 'volume-6db1a8ad-8a7f-46a5-9e00-54822091ede5', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:06:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (028d34e3-67e0-4e32-84e2-fc10c7c860fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:06:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (028d34e3-67e0-4e32-84e2-fc10c7c860fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:06:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9649c7e-7fed-44ca-a164-0c59169e49db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:06:11 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Volume 6db1a8ad-8a7f-46a5-9e00-54822091ede5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6db1a8ad-8a7f-46a5-9e00-54822091ede5', 'volume_size': 1} Apr 27 10:06:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:06:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:06:11 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-28064121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db1a8ad-8a7f-46a5-9e00-54822091ede5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a0e67630a4489ca35da0121c9edd31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:06:11Z,use_quota=True,user_id='e370ed27cbb348a0b5a77da9b477ec37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:06:11 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Creating volume 6db1a8ad-8a7f-46a5-9e00-54822091ede5 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:06:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:06:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:06:11 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:06:11 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:06:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:06:11 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:06:11 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:06:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6db1a8ad-8a7f-46a5-9e00-54822091ede5 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:11 devstack sudo[83353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6db1a8ad-8a7f-46a5-9e00-54822091ede5 1073741824 Apr 27 10:06:11 devstack sudo[83353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:11 devstack sudo[83353]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6db1a8ad-8a7f-46a5-9e00-54822091ede5 1073741824" returned: 0 in 0.791s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6db1a8ad-8a7f-46a5-9e00-54822091ede5 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:12 devstack sudo[83358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6db1a8ad-8a7f-46a5-9e00-54822091ede5 Apr 27 10:06:12 devstack sudo[83358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:12 devstack sudo[83358]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6db1a8ad-8a7f-46a5-9e00-54822091ede5" returned: 0 in 0.526s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:12 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:06:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:06:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9649c7e-7fed-44ca-a164-0c59169e49db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6db1a8ad-8a7f-46a5-9e00-54822091ede5', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:06:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b080979-8523-4cd7-81e6-62a67a9d5691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:06:12 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Volume volume-6db1a8ad-8a7f-46a5-9e00-54822091ede5 (6db1a8ad-8a7f-46a5-9e00-54822091ede5): created successfully Apr 27 10:06:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b080979-8523-4cd7-81e6-62a67a9d5691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:06:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Flow 'volume_create_manager' (08ae5e0c-6891-48c7-a299-3291a67598bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:06:12 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-bc58f6af-70e7-4900-83cd-94379e6bc920 tempest-AbsoluteLimitsTests-1526040615 None] Created volume successfully. Apr 27 10:06:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e01300cf-2ac2-4668-be8c-8d3e2aab290f tempest-AbsoluteLimitsTests-1526040615 None] Acquiring lock "cinder-6db1a8ad-8a7f-46a5-9e00-54822091ede5-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:06:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e01300cf-2ac2-4668-be8c-8d3e2aab290f tempest-AbsoluteLimitsTests-1526040615 None] Lock "cinder-6db1a8ad-8a7f-46a5-9e00-54822091ede5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:06:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e01300cf-2ac2-4668-be8c-8d3e2aab290f tempest-AbsoluteLimitsTests-1526040615 None] Acquiring lock "cinder-quobyte-6db1a8ad-8a7f-46a5-9e00-54822091ede5" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:06:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e01300cf-2ac2-4668-be8c-8d3e2aab290f tempest-AbsoluteLimitsTests-1526040615 None] Lock "cinder-quobyte-6db1a8ad-8a7f-46a5-9e00-54822091ede5" acquired by "delete_volume" :: waited 0.033s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:06:13 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[24796169-5322-4b97-b6db-f7c39f82a627]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:06:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e01300cf-2ac2-4668-be8c-8d3e2aab290f tempest-AbsoluteLimitsTests-1526040615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6db1a8ad-8a7f-46a5-9e00-54822091ede5 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:13 devstack sudo[83361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6db1a8ad-8a7f-46a5-9e00-54822091ede5 Apr 27 10:06:13 devstack sudo[83361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:14 devstack sudo[83361]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e01300cf-2ac2-4668-be8c-8d3e2aab290f tempest-AbsoluteLimitsTests-1526040615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6db1a8ad-8a7f-46a5-9e00-54822091ede5" returned: 0 in 0.756s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e01300cf-2ac2-4668-be8c-8d3e2aab290f tempest-AbsoluteLimitsTests-1526040615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6db1a8ad-8a7f-46a5-9e00-54822091ede5 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:14 devstack sudo[83366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6db1a8ad-8a7f-46a5-9e00-54822091ede5 Apr 27 10:06:14 devstack sudo[83366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:14 devstack sudo[83366]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e01300cf-2ac2-4668-be8c-8d3e2aab290f tempest-AbsoluteLimitsTests-1526040615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6db1a8ad-8a7f-46a5-9e00-54822091ede5" returned: 0 in 0.587s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:14 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e01300cf-2ac2-4668-be8c-8d3e2aab290f tempest-AbsoluteLimitsTests-1526040615 None] Lock "cinder-quobyte-6db1a8ad-8a7f-46a5-9e00-54822091ede5" released by "delete_volume" :: held 1.400s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:06:14 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-e01300cf-2ac2-4668-be8c-8d3e2aab290f tempest-AbsoluteLimitsTests-1526040615 None] Created reservations ['3ea4bbb6-b3fe-4d72-be47-e2406edf87c2', 'c24e4ef5-0d74-4649-a788-cef0dab04aee', '9bb815d0-e59b-4caf-91d6-79d8a93f1f1e', '0025b26d-6352-4f8c-afe1-72753fc010b7'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:06:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e01300cf-2ac2-4668-be8c-8d3e2aab290f tempest-AbsoluteLimitsTests-1526040615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:06:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e01300cf-2ac2-4668-be8c-8d3e2aab290f tempest-AbsoluteLimitsTests-1526040615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:06:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e01300cf-2ac2-4668-be8c-8d3e2aab290f tempest-AbsoluteLimitsTests-1526040615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:06:15 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e01300cf-2ac2-4668-be8c-8d3e2aab290f tempest-AbsoluteLimitsTests-1526040615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:06:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e01300cf-2ac2-4668-be8c-8d3e2aab290f tempest-AbsoluteLimitsTests-1526040615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:06:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e01300cf-2ac2-4668-be8c-8d3e2aab290f tempest-AbsoluteLimitsTests-1526040615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:15 devstack sudo[83377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:06:15 devstack sudo[83377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:15 devstack sudo[83377]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e01300cf-2ac2-4668-be8c-8d3e2aab290f tempest-AbsoluteLimitsTests-1526040615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.554s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:15 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-e01300cf-2ac2-4668-be8c-8d3e2aab290f tempest-AbsoluteLimitsTests-1526040615 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:06:15 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-e01300cf-2ac2-4668-be8c-8d3e2aab290f tempest-AbsoluteLimitsTests-1526040615 None] Deleted volume successfully. Apr 27 10:06:15 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e01300cf-2ac2-4668-be8c-8d3e2aab290f tempest-AbsoluteLimitsTests-1526040615 None] Lock "cinder-6db1a8ad-8a7f-46a5-9e00-54822091ede5-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:06:16 devstack cinder-volume[81350]: DEBUG oslo_service.periodic_task [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81350) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 10:06:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:06:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:06:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:06:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:06:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:06:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:16 devstack sudo[83395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:06:16 devstack sudo[83395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:17 devstack sudo[83395]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.603s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:17 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:06:21 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:06:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Flow 'volume_create_manager' (3efb1b1f-763f-4928-b2b7-d68544c830f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:06:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff8ba20-fd81-40aa-befd-2892349ba0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:06:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff8ba20-fd81-40aa-befd-2892349ba0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-445355139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dba418b-4a2c-45ce-a046-99727aeb653f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8cd1c9478342ac9e5d601128f03a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:06:22Z,use_quota=True,user_id='d8183d3cce4648d89fed7111ba87e810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:06:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c1a2dde-2c56-463b-a729-847010128222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:06:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c1a2dde-2c56-463b-a729-847010128222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:06:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66127a84-739d-40cd-8ab9-109fef7db126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:06:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66127a84-739d-40cd-8ab9-109fef7db126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dba418b-4a2c-45ce-a046-99727aeb653f', 'volume_name': 'volume-7dba418b-4a2c-45ce-a046-99727aeb653f', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:06:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f120f1c1-d30f-488b-b375-0b2f053ba206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:06:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f120f1c1-d30f-488b-b375-0b2f053ba206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:06:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (624abf2d-0c1f-4ca6-81f5-9ca956efc8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:06:21 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Volume 7dba418b-4a2c-45ce-a046-99727aeb653f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dba418b-4a2c-45ce-a046-99727aeb653f', 'volume_size': 1} Apr 27 10:06:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:06:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:06:21 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-445355139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dba418b-4a2c-45ce-a046-99727aeb653f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8cd1c9478342ac9e5d601128f03a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:06:22Z,use_quota=True,user_id='d8183d3cce4648d89fed7111ba87e810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:06:21 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Creating volume 7dba418b-4a2c-45ce-a046-99727aeb653f {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:06:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:06:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:06:21 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:06:21 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:06:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:06:21 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:06:21 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:06:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:22 devstack sudo[83500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f 1073741824 Apr 27 10:06:22 devstack sudo[83500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:24 devstack sudo[83500]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f 1073741824" returned: 0 in 2.276s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:24 devstack sudo[83523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f Apr 27 10:06:24 devstack sudo[83523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:25 devstack sudo[83523]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f" returned: 0 in 1.279s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:25 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] <== create_volume: return (3621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:06:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.624s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:06:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (624abf2d-0c1f-4ca6-81f5-9ca956efc8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dba418b-4a2c-45ce-a046-99727aeb653f', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:06:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3fc3dd-9b77-4a62-b105-160bda8acd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:06:25 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Volume volume-7dba418b-4a2c-45ce-a046-99727aeb653f (7dba418b-4a2c-45ce-a046-99727aeb653f): created successfully Apr 27 10:06:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3fc3dd-9b77-4a62-b105-160bda8acd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:06:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Flow 'volume_create_manager' (3efb1b1f-763f-4928-b2b7-d68544c830f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:06:25 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-ab43f24a-07b3-4c9c-9212-69ce8c28defa tempest-VolumesCloneTest-1415444166 None] Created volume successfully. Apr 27 10:06:27 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:06:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Flow 'volume_create_manager' (27536b90-9cda-470b-b1a5-99e08e3d85a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:06:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb22efd1-7fe2-488d-b6d6-ae8bdd6db97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:06:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb22efd1-7fe2-488d-b6d6-ae8bdd6db97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-265829248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d1fba1-2b46-42a8-9ed5-4a602f5708ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8cd1c9478342ac9e5d601128f03a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:06:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=7dba418b-4a2c-45ce-a046-99727aeb653f,status='creating',terminated_at=None,updated_at=2026-04-27T08:06:27Z,use_quota=True,user_id='d8183d3cce4648d89fed7111ba87e810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:06:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071bd641-8bd1-4647-95db-ca91ae521f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:06:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071bd641-8bd1-4647-95db-ca91ae521f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:06:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc18d968-0c99-498a-9183-97201f3f1f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:06:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc18d968-0c99-498a-9183-97201f3f1f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a2d1fba1-2b46-42a8-9ed5-4a602f5708ec', 'volume_name': 'volume-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec', 'volume_size': 2, 'source_volid': '7dba418b-4a2c-45ce-a046-99727aeb653f', 'source_volstatus': 'available'}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:06:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b804fa-3a3a-4f66-9d70-0d153cc74512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:06:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b804fa-3a3a-4f66-9d70-0d153cc74512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:06:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0bd519-eeb5-44fa-8868-e9fe725d4b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:06:27 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Volume a2d1fba1-2b46-42a8-9ed5-4a602f5708ec: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec', 'volume_size': 2, 'source_volid': '7dba418b-4a2c-45ce-a046-99727aeb653f', 'source_volstatus': 'available'} Apr 27 10:06:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:06:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:06:27 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Cloning volume 7dba418b-4a2c-45ce-a046-99727aeb653f to volume a2d1fba1-2b46-42a8-9ed5-4a602f5708ec Apr 27 10:06:27 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Creating offline snapshot 2a284ffc-c6be-4453-8668-f3a1667a89b5 of volume 7dba418b-4a2c-45ce-a046-99727aeb653f {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:06:27 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[037c7606-38d4-4c6d-b878-3fc16d9b8374]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:06:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:28 devstack sudo[83531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f Apr 27 10:06:28 devstack sudo[83531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:29 devstack sudo[83531]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f" returned: 0 in 1.363s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.2a284ffc-c6be-4453-8668-f3a1667a89b5 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:29 devstack sudo[83537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.2a284ffc-c6be-4453-8668-f3a1667a89b5 1G Apr 27 10:06:29 devstack sudo[83537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:30 devstack sudo[83537]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.2a284ffc-c6be-4453-8668-f3a1667a89b5 1G" returned: 0 in 1.631s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dba418b-4a2c-45ce-a046-99727aeb653f -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.2a284ffc-c6be-4453-8668-f3a1667a89b5 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:31 devstack sudo[83553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dba418b-4a2c-45ce-a046-99727aeb653f -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.2a284ffc-c6be-4453-8668-f3a1667a89b5 Apr 27 10:06:31 devstack sudo[83553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:32 devstack sudo[83553]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dba418b-4a2c-45ce-a046-99727aeb653f -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.2a284ffc-c6be-4453-8668-f3a1667a89b5" returned: 0 in 1.356s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:32 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.2a284ffc-c6be-4453-8668-f3a1667a89b5 is being set with open permissions: ugo+rw Apr 27 10:06:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.2a284ffc-c6be-4453-8668-f3a1667a89b5 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:32 devstack sudo[83586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.2a284ffc-c6be-4453-8668-f3a1667a89b5 Apr 27 10:06:32 devstack sudo[83586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:32 devstack sudo[83586]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.2a284ffc-c6be-4453-8668-f3a1667a89b5" returned: 0 in 0.610s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:33 devstack sudo[83595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.info Apr 27 10:06:33 devstack sudo[83595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:33 devstack sudo[83595]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.info" returned: 0 in 0.701s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:33 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.info is being set with open permissions: ugo+rw Apr 27 10:06:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:33 devstack sudo[83609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.info Apr 27 10:06:33 devstack sudo[83609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:34 devstack sudo[83609]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.info" returned: 0 in 1.005s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:34 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Acquiring lock "cinder-quobyte-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec" by "_copy_volume_from_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:06:34 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Lock "cinder-quobyte-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:06:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] snapshot: 2a284ffc-c6be-4453-8668-f3a1667a89b5, volume: a2d1fba1-2b46-42a8-9ed5-4a602f5708ec, {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 27 10:06:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:06:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:06:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:06:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:06:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:06:34 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a2244e-b8b4-4c33-8454-9078b42eab5c]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:06:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.2a284ffc-c6be-4453-8668-f3a1667a89b5 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:34 devstack sudo[83643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.2a284ffc-c6be-4453-8668-f3a1667a89b5 Apr 27 10:06:34 devstack sudo[83643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:35 devstack sudo[83643]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.2a284ffc-c6be-4453-8668-f3a1667a89b5" returned: 0 in 0.978s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7dba418b-4a2c-45ce-a046-99727aeb653f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:06:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 27 10:06:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Creating direct copy from snapshot {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 27 10:06:35 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[902b01fb-e6ed-4013-89bf-676827d791e1]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:06:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:35 devstack sudo[83663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f Apr 27 10:06:35 devstack sudo[83663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:37 devstack sudo[83663]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f" returned: 0 in 1.971s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:37 devstack cinder-volume[81350]: DEBUG cinder.utils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Path /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec not found in is_blk_device check {{(pid=81350) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 27 10:06:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:37 devstack sudo[83690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec Apr 27 10:06:37 devstack sudo[83690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:42 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:SELECT=33,cinder:UPDATE=52,cinder:INSERT=9,cinder:DELETE=2 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:06:42 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:SELECT=19,cinder:INSERT=12,cinder:UPDATE=21,cinder:DELETE=3 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:06:45 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:06:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Flow 'volume_create_manager' (b919b6f4-6960-4241-ae13-e23b4916993f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:06:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34dedc9e-5d8f-47c3-9a2b-bf2fd1d556b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:06:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34dedc9e-5d8f-47c3-9a2b-bf2fd1d556b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2107192924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1caeff10-d51b-4bd7-9c36-a511a29c9182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63ed840455e746eb85bddb5330602bb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:06:46Z,use_quota=True,user_id='f8c4f92fc09341c3a44c4b13ccc08d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:06:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b62213e-8a4e-48ef-83df-75e6db355221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:06:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b62213e-8a4e-48ef-83df-75e6db355221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:06:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7886cc35-85f3-4a8d-a21f-d34eee16c9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:06:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7886cc35-85f3-4a8d-a21f-d34eee16c9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1caeff10-d51b-4bd7-9c36-a511a29c9182', 'volume_name': 'volume-1caeff10-d51b-4bd7-9c36-a511a29c9182', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:06:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd05d532-c92b-4e34-b838-bec49ec8a242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:06:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd05d532-c92b-4e34-b838-bec49ec8a242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:06:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a25f00-88ae-43a3-9fe9-1ef3db4f8770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:06:46 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Volume 1caeff10-d51b-4bd7-9c36-a511a29c9182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1caeff10-d51b-4bd7-9c36-a511a29c9182', 'volume_size': 1} Apr 27 10:06:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:06:50 devstack sudo[83690]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec" returned: 0 in 12.585s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:50 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68d99f0-cadf-481d-8dab-f59d38864b0b]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:06:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:50 devstack sudo[83830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f Apr 27 10:06:50 devstack sudo[83830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:51 devstack sudo[83830]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f" returned: 0 in 1.460s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:51 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Image conversion details: src /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f, size 1024.00 MB, duration 12.59 sec, destination /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec {{(pid=81350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 10:06:51 devstack cinder-volume[81350]: INFO cinder.image.image_utils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Converted 1024.00 MB image at 81.36 MB/s Apr 27 10:06:51 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec is being set with open permissions: ugo+rw Apr 27 10:06:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:51 devstack sudo[83869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec Apr 27 10:06:51 devstack sudo[83869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:53 devstack sudo[83869]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec" returned: 0 in 1.151s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:53 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Lock "cinder-quobyte-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec" released by "_copy_volume_from_snapshot" :: held 18.346s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:06:53 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Acquiring lock "cinder-quobyte-2a284ffc-c6be-4453-8668-f3a1667a89b5" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:06:53 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Lock "cinder-quobyte-2a284ffc-c6be-4453-8668-f3a1667a89b5" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:06:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Deleting offline snapshot 2a284ffc-c6be-4453-8668-f3a1667a89b5 of volume 7dba418b-4a2c-45ce-a046-99727aeb653f {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:06:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] snapshot_file for this snap is: volume-7dba418b-4a2c-45ce-a046-99727aeb653f.2a284ffc-c6be-4453-8668-f3a1667a89b5 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:06:53 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61f8233-82dc-47e5-a519-c00c0690a4d8]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:06:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.2a284ffc-c6be-4453-8668-f3a1667a89b5 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:53 devstack sudo[83921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.2a284ffc-c6be-4453-8668-f3a1667a89b5 Apr 27 10:06:53 devstack sudo[83921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:53 devstack sudo[83921]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.2a284ffc-c6be-4453-8668-f3a1667a89b5" returned: 0 in 0.774s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7dba418b-4a2c-45ce-a046-99727aeb653f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:06:54 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[57800c3c-5898-4435-b21a-52d4c6a36d3e]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:06:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:54 devstack sudo[83928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f Apr 27 10:06:54 devstack sudo[83928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:54 devstack sudo[83928]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f" returned: 0 in 0.845s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.2a284ffc-c6be-4453-8668-f3a1667a89b5 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:54 devstack sudo[83934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.2a284ffc-c6be-4453-8668-f3a1667a89b5 Apr 27 10:06:54 devstack sudo[83934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:55 devstack sudo[83934]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.2a284ffc-c6be-4453-8668-f3a1667a89b5" returned: 0 in 0.986s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.2a284ffc-c6be-4453-8668-f3a1667a89b5 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:55 devstack sudo[83959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.2a284ffc-c6be-4453-8668-f3a1667a89b5 Apr 27 10:06:55 devstack sudo[83959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:56 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:SELECT=2 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:06:56 devstack sudo[83959]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f.2a284ffc-c6be-4453-8668-f3a1667a89b5" returned: 0 in 0.637s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:56 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Lock "cinder-quobyte-2a284ffc-c6be-4453-8668-f3a1667a89b5" released by "_delete_snapshot" :: held 3.364s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:06:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 28.785s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:06:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.157s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:06:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2107192924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1caeff10-d51b-4bd7-9c36-a511a29c9182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63ed840455e746eb85bddb5330602bb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:06:46Z,use_quota=True,user_id='f8c4f92fc09341c3a44c4b13ccc08d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:06:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Creating volume 1caeff10-d51b-4bd7-9c36-a511a29c9182 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:06:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:06:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:06:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:06:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:06:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:06:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:06:56 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:06:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1caeff10-d51b-4bd7-9c36-a511a29c9182 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0bd519-eeb5-44fa-8868-e9fe725d4b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec', 'volume_size': 2, 'source_volid': '7dba418b-4a2c-45ce-a046-99727aeb653f', 'source_volstatus': 'available'}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:06:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10c8fc84-9c66-4900-b6ea-3395e4ce959d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:06:56 devstack sudo[83962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1caeff10-d51b-4bd7-9c36-a511a29c9182 1073741824 Apr 27 10:06:56 devstack sudo[83962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:56 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Volume volume-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec (a2d1fba1-2b46-42a8-9ed5-4a602f5708ec): created successfully Apr 27 10:06:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10c8fc84-9c66-4900-b6ea-3395e4ce959d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:06:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Flow 'volume_create_manager' (27536b90-9cda-470b-b1a5-99e08e3d85a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:06:56 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-191cedb0-97fe-4fac-ae50-46b998083692 tempest-VolumesCloneTest-1415444166 None] Created volume successfully. Apr 27 10:06:57 devstack sudo[83962]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1caeff10-d51b-4bd7-9c36-a511a29c9182 1073741824" returned: 0 in 0.804s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1caeff10-d51b-4bd7-9c36-a511a29c9182 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:57 devstack sudo[83967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1caeff10-d51b-4bd7-9c36-a511a29c9182 Apr 27 10:06:57 devstack sudo[83967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:57 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9bbccde5-b944-4593-979d-3524d89882f0 tempest-VolumesCloneTest-1415444166 None] Acquiring lock "cinder-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:06:57 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9bbccde5-b944-4593-979d-3524d89882f0 tempest-VolumesCloneTest-1415444166 None] Lock "cinder-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:06:57 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9bbccde5-b944-4593-979d-3524d89882f0 tempest-VolumesCloneTest-1415444166 None] Acquiring lock "cinder-quobyte-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:06:57 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9bbccde5-b944-4593-979d-3524d89882f0 tempest-VolumesCloneTest-1415444166 None] Lock "cinder-quobyte-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec" acquired by "delete_volume" :: waited 0.022s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:06:57 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e97406-abb4-45ff-8144-49c51cec6446]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:06:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9bbccde5-b944-4593-979d-3524d89882f0 tempest-VolumesCloneTest-1415444166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:57 devstack sudo[83969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec Apr 27 10:06:57 devstack sudo[83969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:57 devstack sudo[83967]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1caeff10-d51b-4bd7-9c36-a511a29c9182" returned: 0 in 0.602s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:06:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:06:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a25f00-88ae-43a3-9fe9-1ef3db4f8770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1caeff10-d51b-4bd7-9c36-a511a29c9182', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:06:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c16bc6c-ef28-4ad3-b06c-e03736f8e42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:06:58 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Volume volume-1caeff10-d51b-4bd7-9c36-a511a29c9182 (1caeff10-d51b-4bd7-9c36-a511a29c9182): created successfully Apr 27 10:06:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c16bc6c-ef28-4ad3-b06c-e03736f8e42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:06:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Flow 'volume_create_manager' (b919b6f4-6960-4241-ae13-e23b4916993f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:06:58 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-185524c0-b1f5-49a7-93f3-d92777e7a41b tempest-ServerRescueNegativeTestJSON-1281626689 None] Created volume successfully. Apr 27 10:06:58 devstack sudo[83969]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9bbccde5-b944-4593-979d-3524d89882f0 tempest-VolumesCloneTest-1415444166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec" returned: 0 in 0.720s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9bbccde5-b944-4593-979d-3524d89882f0 tempest-VolumesCloneTest-1415444166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:58 devstack sudo[83980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec Apr 27 10:06:58 devstack sudo[83980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:59 devstack sudo[83980]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9bbccde5-b944-4593-979d-3524d89882f0 tempest-VolumesCloneTest-1415444166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec" returned: 0 in 0.563s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:59 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9bbccde5-b944-4593-979d-3524d89882f0 tempest-VolumesCloneTest-1415444166 None] Lock "cinder-quobyte-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec" released by "delete_volume" :: held 1.326s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:06:59 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-9bbccde5-b944-4593-979d-3524d89882f0 tempest-VolumesCloneTest-1415444166 None] Created reservations ['cfb2b598-7790-47ab-a577-75296a4d7ec9', 'a757e5d5-43da-42eb-88b4-6e6a933e2e02', 'b31f7222-9e50-4898-87a9-9ab03d98e3b5', '19600f93-25a5-477b-9f2e-b8ed2ed41104'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:06:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-9bbccde5-b944-4593-979d-3524d89882f0 tempest-VolumesCloneTest-1415444166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:06:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-9bbccde5-b944-4593-979d-3524d89882f0 tempest-VolumesCloneTest-1415444166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:06:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-9bbccde5-b944-4593-979d-3524d89882f0 tempest-VolumesCloneTest-1415444166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:06:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-9bbccde5-b944-4593-979d-3524d89882f0 tempest-VolumesCloneTest-1415444166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:06:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-9bbccde5-b944-4593-979d-3524d89882f0 tempest-VolumesCloneTest-1415444166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:06:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9bbccde5-b944-4593-979d-3524d89882f0 tempest-VolumesCloneTest-1415444166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:06:59 devstack sudo[83983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:06:59 devstack sudo[83983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:06:59 devstack sudo[83983]: pam_unix(sudo:session): session closed for user root Apr 27 10:06:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9bbccde5-b944-4593-979d-3524d89882f0 tempest-VolumesCloneTest-1415444166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.468s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:06:59 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-9bbccde5-b944-4593-979d-3524d89882f0 tempest-VolumesCloneTest-1415444166 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:06:59 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-9bbccde5-b944-4593-979d-3524d89882f0 tempest-VolumesCloneTest-1415444166 None] Deleted volume successfully. Apr 27 10:06:59 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9bbccde5-b944-4593-979d-3524d89882f0 tempest-VolumesCloneTest-1415444166 None] Lock "cinder-a2d1fba1-2b46-42a8-9ed5-4a602f5708ec-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:07:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b2f9d8c1-f394-4c48-b0bd-9096770cc188 tempest-VolumesCloneTest-1415444166 None] Acquiring lock "cinder-7dba418b-4a2c-45ce-a046-99727aeb653f-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:07:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b2f9d8c1-f394-4c48-b0bd-9096770cc188 tempest-VolumesCloneTest-1415444166 None] Lock "cinder-7dba418b-4a2c-45ce-a046-99727aeb653f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:07:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b2f9d8c1-f394-4c48-b0bd-9096770cc188 tempest-VolumesCloneTest-1415444166 None] Acquiring lock "cinder-quobyte-7dba418b-4a2c-45ce-a046-99727aeb653f" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:07:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b2f9d8c1-f394-4c48-b0bd-9096770cc188 tempest-VolumesCloneTest-1415444166 None] Lock "cinder-quobyte-7dba418b-4a2c-45ce-a046-99727aeb653f" acquired by "delete_volume" :: waited 0.015s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:07:00 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9ac9e4-6a14-4a27-a2f5-714c4efc5dd5]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:07:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b2f9d8c1-f394-4c48-b0bd-9096770cc188 tempest-VolumesCloneTest-1415444166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:00 devstack sudo[83992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f Apr 27 10:07:00 devstack sudo[83992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:00 devstack sudo[83992]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b2f9d8c1-f394-4c48-b0bd-9096770cc188 tempest-VolumesCloneTest-1415444166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f" returned: 0 in 0.693s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b2f9d8c1-f394-4c48-b0bd-9096770cc188 tempest-VolumesCloneTest-1415444166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:01 devstack sudo[84018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f Apr 27 10:07:01 devstack sudo[84018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:01 devstack sudo[84018]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b2f9d8c1-f394-4c48-b0bd-9096770cc188 tempest-VolumesCloneTest-1415444166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7dba418b-4a2c-45ce-a046-99727aeb653f" returned: 0 in 0.539s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:01 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b2f9d8c1-f394-4c48-b0bd-9096770cc188 tempest-VolumesCloneTest-1415444166 None] Lock "cinder-quobyte-7dba418b-4a2c-45ce-a046-99727aeb653f" released by "delete_volume" :: held 1.325s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:07:01 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-b2f9d8c1-f394-4c48-b0bd-9096770cc188 tempest-VolumesCloneTest-1415444166 None] Created reservations ['78c7a356-6a5e-4cbc-bbe8-9d2743d48de7', '4f509ec0-93c9-4f68-b9b4-681ab314c95c', 'e9a3c21e-9b6e-4658-ba8d-2ac197194818', '98ed9922-a9c2-48c9-bfa6-79a7de9665b3'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:07:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b2f9d8c1-f394-4c48-b0bd-9096770cc188 tempest-VolumesCloneTest-1415444166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b2f9d8c1-f394-4c48-b0bd-9096770cc188 tempest-VolumesCloneTest-1415444166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b2f9d8c1-f394-4c48-b0bd-9096770cc188 tempest-VolumesCloneTest-1415444166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:07:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b2f9d8c1-f394-4c48-b0bd-9096770cc188 tempest-VolumesCloneTest-1415444166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:07:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b2f9d8c1-f394-4c48-b0bd-9096770cc188 tempest-VolumesCloneTest-1415444166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b2f9d8c1-f394-4c48-b0bd-9096770cc188 tempest-VolumesCloneTest-1415444166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:01 devstack sudo[84042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:07:01 devstack sudo[84042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:02 devstack sudo[84042]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b2f9d8c1-f394-4c48-b0bd-9096770cc188 tempest-VolumesCloneTest-1415444166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.737s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:02 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-b2f9d8c1-f394-4c48-b0bd-9096770cc188 tempest-VolumesCloneTest-1415444166 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:07:02 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-b2f9d8c1-f394-4c48-b0bd-9096770cc188 tempest-VolumesCloneTest-1415444166 None] Deleted volume successfully. Apr 27 10:07:02 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b2f9d8c1-f394-4c48-b0bd-9096770cc188 tempest-VolumesCloneTest-1415444166 None] Lock "cinder-7dba418b-4a2c-45ce-a046-99727aeb653f-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:07:11 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:UPDATE=24,cinder:SELECT=9,cinder:DELETE=3,cinder:INSERT=8 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:07:12 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:UPDATE=22,cinder:SELECT=16,cinder:INSERT=2,cinder:DELETE=1 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:07:16 devstack cinder-volume[81350]: DEBUG oslo_service.periodic_task [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81350) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 10:07:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:07:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:07:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:16 devstack sudo[84275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:07:16 devstack sudo[84275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:17 devstack sudo[84275]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.743s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:17 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:07:18 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:07:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Flow 'volume_create_manager' (e3be910a-9dfe-4d09-9a9f-830f4f4d3506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:07:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde3b782-438f-4603-9c97-5d2b0bf0fd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde3b782-438f-4603-9c97-5d2b0bf0fd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-414702443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77935a77-a8f5-495a-88a2-659a0700256e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b7993040c8c41708d8e24f66ec399ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:07:18Z,use_quota=True,user_id='a1a01b07cab342c988e43a5697d3eec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9392b9-f9e8-4c7b-90d4-948d23bc1560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9392b9-f9e8-4c7b-90d4-948d23bc1560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ea7a5f-6c5c-4161-b3c5-310e779d095e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ea7a5f-6c5c-4161-b3c5-310e779d095e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77935a77-a8f5-495a-88a2-659a0700256e', 'volume_name': 'volume-77935a77-a8f5-495a-88a2-659a0700256e', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39466587-e2cc-41b7-aebe-63a7795bbea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39466587-e2cc-41b7-aebe-63a7795bbea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b199b1-799d-417c-9483-8f789e17c593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:18 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Volume 77935a77-a8f5-495a-88a2-659a0700256e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77935a77-a8f5-495a-88a2-659a0700256e', 'volume_size': 1} Apr 27 10:07:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:18 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-414702443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77935a77-a8f5-495a-88a2-659a0700256e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b7993040c8c41708d8e24f66ec399ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:07:18Z,use_quota=True,user_id='a1a01b07cab342c988e43a5697d3eec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:07:18 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Creating volume 77935a77-a8f5-495a-88a2-659a0700256e {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:07:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:18 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:07:18 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:07:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:18 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:07:18 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:07:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-77935a77-a8f5-495a-88a2-659a0700256e 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:18 devstack sudo[84311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-77935a77-a8f5-495a-88a2-659a0700256e 1073741824 Apr 27 10:07:18 devstack sudo[84311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:19 devstack sudo[84311]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-77935a77-a8f5-495a-88a2-659a0700256e 1073741824" returned: 0 in 1.021s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-77935a77-a8f5-495a-88a2-659a0700256e {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:19 devstack sudo[84329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-77935a77-a8f5-495a-88a2-659a0700256e Apr 27 10:07:19 devstack sudo[84329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:20 devstack sudo[84329]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-77935a77-a8f5-495a-88a2-659a0700256e" returned: 0 in 1.008s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:20 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] <== create_volume: return (2088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:07:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.091s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:20 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b199b1-799d-417c-9483-8f789e17c593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77935a77-a8f5-495a-88a2-659a0700256e', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:20 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b76e59a7-0fcc-4a5d-9c97-7d0e430c83ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:20 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Volume volume-77935a77-a8f5-495a-88a2-659a0700256e (77935a77-a8f5-495a-88a2-659a0700256e): created successfully Apr 27 10:07:20 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b76e59a7-0fcc-4a5d-9c97-7d0e430c83ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:20 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Flow 'volume_create_manager' (e3be910a-9dfe-4d09-9a9f-830f4f4d3506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:07:20 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-ff8244e6-3648-4445-afb9-d73830a2d618 tempest-ServersNegativeTestJSON-465113645 None] Created volume successfully. Apr 27 10:07:22 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-89925116-32c0-4062-8b4f-1ef3ae846933 tempest-ServerRescueNegativeTestJSON-1281626689 None] Acquiring lock "cinder-1caeff10-d51b-4bd7-9c36-a511a29c9182-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:07:22 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-89925116-32c0-4062-8b4f-1ef3ae846933 tempest-ServerRescueNegativeTestJSON-1281626689 None] Lock "cinder-1caeff10-d51b-4bd7-9c36-a511a29c9182-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:07:22 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-89925116-32c0-4062-8b4f-1ef3ae846933 tempest-ServerRescueNegativeTestJSON-1281626689 None] Acquiring lock "cinder-quobyte-1caeff10-d51b-4bd7-9c36-a511a29c9182" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:07:22 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-89925116-32c0-4062-8b4f-1ef3ae846933 tempest-ServerRescueNegativeTestJSON-1281626689 None] Lock "cinder-quobyte-1caeff10-d51b-4bd7-9c36-a511a29c9182" acquired by "delete_volume" :: waited 0.064s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:07:22 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3b76ee-3ff6-4c38-8696-de0c400016f8]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:07:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-89925116-32c0-4062-8b4f-1ef3ae846933 tempest-ServerRescueNegativeTestJSON-1281626689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1caeff10-d51b-4bd7-9c36-a511a29c9182 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:22 devstack sudo[84379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1caeff10-d51b-4bd7-9c36-a511a29c9182 Apr 27 10:07:22 devstack sudo[84379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:23 devstack sudo[84379]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-89925116-32c0-4062-8b4f-1ef3ae846933 tempest-ServerRescueNegativeTestJSON-1281626689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1caeff10-d51b-4bd7-9c36-a511a29c9182" returned: 0 in 1.050s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-89925116-32c0-4062-8b4f-1ef3ae846933 tempest-ServerRescueNegativeTestJSON-1281626689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1caeff10-d51b-4bd7-9c36-a511a29c9182 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:23 devstack sudo[84384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1caeff10-d51b-4bd7-9c36-a511a29c9182 Apr 27 10:07:23 devstack sudo[84384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:23 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Flow 'volume_create_manager' (4a6d60b5-3b7d-4eb4-9b6b-374b66e606ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704df34e-18b6-4ac2-bd6f-149b08c47589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704df34e-18b6-4ac2-bd6f-149b08c47589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1091523874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f1feb22-2fae-4023-bf35-8c6e0594943e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a66e2922c547b68c14b3aca35d55bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:07:24Z,use_quota=True,user_id='9b4e8350433047bab63c9604cff72955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd7ecefc-403e-4749-b23a-a0f4001bcbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd7ecefc-403e-4749-b23a-a0f4001bcbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd4394b-dc53-4567-851d-0af59624b36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd4394b-dc53-4567-851d-0af59624b36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f1feb22-2fae-4023-bf35-8c6e0594943e', 'volume_name': 'volume-8f1feb22-2fae-4023-bf35-8c6e0594943e', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6d83f68-3cdf-411d-a229-6f203a0f8b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6d83f68-3cdf-411d-a229-6f203a0f8b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71f59d8-1514-4ad3-aa53-15df1c098dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:24 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Volume 8f1feb22-2fae-4023-bf35-8c6e0594943e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f1feb22-2fae-4023-bf35-8c6e0594943e', 'volume_size': 1} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1091523874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f1feb22-2fae-4023-bf35-8c6e0594943e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a66e2922c547b68c14b3aca35d55bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:07:24Z,use_quota=True,user_id='9b4e8350433047bab63c9604cff72955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Creating volume 8f1feb22-2fae-4023-bf35-8c6e0594943e {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:07:24 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:24 devstack sudo[84386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e 1073741824 Apr 27 10:07:24 devstack sudo[84386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Flow 'volume_create_manager' (e7b05271-a865-4618-84fb-b1f20f7dd0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a314075-4cd8-4878-8bbe-dac32804ea1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a314075-4cd8-4878-8bbe-dac32804ea1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-618206592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b078d4d5-2977-4c97-b352-838d14bd62e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b7993040c8c41708d8e24f66ec399ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:07:25Z,use_quota=True,user_id='a1a01b07cab342c988e43a5697d3eec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (263d2f2d-fced-4074-bac5-2e1e01a1943a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (263d2f2d-fced-4074-bac5-2e1e01a1943a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d572fe2e-c046-46e7-8b91-91115812b5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d572fe2e-c046-46e7-8b91-91115812b5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b078d4d5-2977-4c97-b352-838d14bd62e4', 'volume_name': 'volume-b078d4d5-2977-4c97-b352-838d14bd62e4', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82786e15-3300-4ebe-b605-8ff73bfd0f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82786e15-3300-4ebe-b605-8ff73bfd0f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6a50e5-9147-45d8-850a-bb3df739ce68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:24 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Volume b078d4d5-2977-4c97-b352-838d14bd62e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b078d4d5-2977-4c97-b352-838d14bd62e4', 'volume_size': 1} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:24 devstack sudo[84384]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-89925116-32c0-4062-8b4f-1ef3ae846933 tempest-ServerRescueNegativeTestJSON-1281626689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1caeff10-d51b-4bd7-9c36-a511a29c9182" returned: 0 in 1.142s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:24 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-89925116-32c0-4062-8b4f-1ef3ae846933 tempest-ServerRescueNegativeTestJSON-1281626689 None] Lock "cinder-quobyte-1caeff10-d51b-4bd7-9c36-a511a29c9182" released by "delete_volume" :: held 2.295s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:07:25 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-89925116-32c0-4062-8b4f-1ef3ae846933 tempest-ServerRescueNegativeTestJSON-1281626689 None] Created reservations ['92c9d5f9-465e-451d-98cf-4507bd804c0d', 'f9b9876b-314c-4ac8-bfdc-d042f49454b3', 'dbb19763-8ad6-476d-8baa-28b46e9bdb56', 'dcdaa776-fd5a-4a95-ae74-1e72f3902ccf'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:07:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-89925116-32c0-4062-8b4f-1ef3ae846933 tempest-ServerRescueNegativeTestJSON-1281626689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-89925116-32c0-4062-8b4f-1ef3ae846933 tempest-ServerRescueNegativeTestJSON-1281626689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:25 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-89925116-32c0-4062-8b4f-1ef3ae846933 tempest-ServerRescueNegativeTestJSON-1281626689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:07:25 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-89925116-32c0-4062-8b4f-1ef3ae846933 tempest-ServerRescueNegativeTestJSON-1281626689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:07:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-89925116-32c0-4062-8b4f-1ef3ae846933 tempest-ServerRescueNegativeTestJSON-1281626689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-89925116-32c0-4062-8b4f-1ef3ae846933 tempest-ServerRescueNegativeTestJSON-1281626689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:25 devstack sudo[84391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:07:25 devstack sudo[84391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:25 devstack sudo[84386]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e 1073741824" returned: 0 in 1.403s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:25 devstack sudo[84397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e Apr 27 10:07:25 devstack sudo[84397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:25 devstack sudo[84391]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-89925116-32c0-4062-8b4f-1ef3ae846933 tempest-ServerRescueNegativeTestJSON-1281626689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.802s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:25 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-89925116-32c0-4062-8b4f-1ef3ae846933 tempest-ServerRescueNegativeTestJSON-1281626689 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:07:25 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-89925116-32c0-4062-8b4f-1ef3ae846933 tempest-ServerRescueNegativeTestJSON-1281626689 None] Deleted volume successfully. Apr 27 10:07:26 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-89925116-32c0-4062-8b4f-1ef3ae846933 tempest-ServerRescueNegativeTestJSON-1281626689 None] Lock "cinder-1caeff10-d51b-4bd7-9c36-a511a29c9182-delete_volume" released by "delete_volume" :: held 3.525s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:07:26 devstack sudo[84397]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e" returned: 0 in 0.669s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] <== create_volume: return (2144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:07:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.150s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.521s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-618206592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b078d4d5-2977-4c97-b352-838d14bd62e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b7993040c8c41708d8e24f66ec399ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:07:25Z,use_quota=True,user_id='a1a01b07cab342c988e43a5697d3eec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:07:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Creating volume b078d4d5-2977-4c97-b352-838d14bd62e4 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:07:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:07:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:07:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:07:26 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:07:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b078d4d5-2977-4c97-b352-838d14bd62e4 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71f59d8-1514-4ad3-aa53-15df1c098dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f1feb22-2fae-4023-bf35-8c6e0594943e', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38e6921-a1fd-4f07-a68b-1310dc741714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:26 devstack sudo[84404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b078d4d5-2977-4c97-b352-838d14bd62e4 1073741824 Apr 27 10:07:26 devstack sudo[84404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:26 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Volume volume-8f1feb22-2fae-4023-bf35-8c6e0594943e (8f1feb22-2fae-4023-bf35-8c6e0594943e): created successfully Apr 27 10:07:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38e6921-a1fd-4f07-a68b-1310dc741714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Flow 'volume_create_manager' (4a6d60b5-3b7d-4eb4-9b6b-374b66e606ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:07:26 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-5bc0e8cf-87ad-43f6-b627-5fd6dacdc7a9 tempest-VolumesSnapshotTestJSON-1648254463 None] Created volume successfully. Apr 27 10:07:27 devstack sudo[84404]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b078d4d5-2977-4c97-b352-838d14bd62e4 1073741824" returned: 0 in 1.026s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b078d4d5-2977-4c97-b352-838d14bd62e4 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:27 devstack sudo[84416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b078d4d5-2977-4c97-b352-838d14bd62e4 Apr 27 10:07:27 devstack sudo[84416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-23bc3fdc-a953-4359-a682-cee2749d5ded tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:29 devstack sudo[84416]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b078d4d5-2977-4c97-b352-838d14bd62e4" returned: 0 in 1.700s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:29 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] <== create_volume: return (2770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:07:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.773s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-23bc3fdc-a953-4359-a682-cee2749d5ded tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.616s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:29 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-23bc3fdc-a953-4359-a682-cee2749d5ded tempest-VolumesSnapshotTestJSON-1648254463 None] Creating offline snapshot 3c657da2-bc21-4089-b47c-2fe4a6036161 of volume 8f1feb22-2fae-4023-bf35-8c6e0594943e {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:07:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6a50e5-9147-45d8-850a-bb3df739ce68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b078d4d5-2977-4c97-b352-838d14bd62e4', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37abab4a-2565-4da4-a9f9-520f34e690f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:29 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9008c66-b05a-4a39-99d7-b69ecae85f92]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:07:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-23bc3fdc-a953-4359-a682-cee2749d5ded tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:29 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Volume volume-b078d4d5-2977-4c97-b352-838d14bd62e4 (b078d4d5-2977-4c97-b352-838d14bd62e4): created successfully Apr 27 10:07:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37abab4a-2565-4da4-a9f9-520f34e690f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Flow 'volume_create_manager' (e7b05271-a865-4618-84fb-b1f20f7dd0e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:07:29 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-eaa481cd-6362-4d21-8c0d-581625b660c2 tempest-ServersNegativeTestJSON-465113645 None] Created volume successfully. Apr 27 10:07:29 devstack sudo[84448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e Apr 27 10:07:29 devstack sudo[84448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:31 devstack sudo[84448]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-23bc3fdc-a953-4359-a682-cee2749d5ded tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e" returned: 0 in 2.025s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-23bc3fdc-a953-4359-a682-cee2749d5ded tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.3c657da2-bc21-4089-b47c-2fe4a6036161 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:31 devstack sudo[84481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.3c657da2-bc21-4089-b47c-2fe4a6036161 1G Apr 27 10:07:31 devstack sudo[84481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5ecbe0fa-c2da-459e-a5e4-53cb4d466dfd tempest-ServersNegativeTestJSON-465113645 None] Acquiring lock "cinder-b078d4d5-2977-4c97-b352-838d14bd62e4-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:07:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5ecbe0fa-c2da-459e-a5e4-53cb4d466dfd tempest-ServersNegativeTestJSON-465113645 None] Lock "cinder-b078d4d5-2977-4c97-b352-838d14bd62e4-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:07:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5ecbe0fa-c2da-459e-a5e4-53cb4d466dfd tempest-ServersNegativeTestJSON-465113645 None] Acquiring lock "cinder-quobyte-b078d4d5-2977-4c97-b352-838d14bd62e4" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:07:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5ecbe0fa-c2da-459e-a5e4-53cb4d466dfd tempest-ServersNegativeTestJSON-465113645 None] Lock "cinder-quobyte-b078d4d5-2977-4c97-b352-838d14bd62e4" acquired by "delete_volume" :: waited 0.044s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:07:32 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec658a6-6b86-48d8-a920-62fdd67d1a5d]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:07:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5ecbe0fa-c2da-459e-a5e4-53cb4d466dfd tempest-ServersNegativeTestJSON-465113645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b078d4d5-2977-4c97-b352-838d14bd62e4 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:32 devstack sudo[84496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b078d4d5-2977-4c97-b352-838d14bd62e4 Apr 27 10:07:32 devstack sudo[84496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:32 devstack sudo[84481]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-23bc3fdc-a953-4359-a682-cee2749d5ded tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.3c657da2-bc21-4089-b47c-2fe4a6036161 1G" returned: 0 in 1.077s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-23bc3fdc-a953-4359-a682-cee2749d5ded tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f1feb22-2fae-4023-bf35-8c6e0594943e -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.3c657da2-bc21-4089-b47c-2fe4a6036161 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:32 devstack sudo[84498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f1feb22-2fae-4023-bf35-8c6e0594943e -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.3c657da2-bc21-4089-b47c-2fe4a6036161 Apr 27 10:07:32 devstack sudo[84498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:33 devstack sudo[84496]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5ecbe0fa-c2da-459e-a5e4-53cb4d466dfd tempest-ServersNegativeTestJSON-465113645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b078d4d5-2977-4c97-b352-838d14bd62e4" returned: 0 in 1.264s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5ecbe0fa-c2da-459e-a5e4-53cb4d466dfd tempest-ServersNegativeTestJSON-465113645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b078d4d5-2977-4c97-b352-838d14bd62e4 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:33 devstack sudo[84507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b078d4d5-2977-4c97-b352-838d14bd62e4 Apr 27 10:07:33 devstack sudo[84507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:33 devstack sudo[84498]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-23bc3fdc-a953-4359-a682-cee2749d5ded tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f1feb22-2fae-4023-bf35-8c6e0594943e -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.3c657da2-bc21-4089-b47c-2fe4a6036161" returned: 0 in 1.109s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:33 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-23bc3fdc-a953-4359-a682-cee2749d5ded tempest-VolumesSnapshotTestJSON-1648254463 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.3c657da2-bc21-4089-b47c-2fe4a6036161 is being set with open permissions: ugo+rw Apr 27 10:07:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-23bc3fdc-a953-4359-a682-cee2749d5ded tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.3c657da2-bc21-4089-b47c-2fe4a6036161 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:33 devstack sudo[84509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.3c657da2-bc21-4089-b47c-2fe4a6036161 Apr 27 10:07:33 devstack sudo[84509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:34 devstack sudo[84507]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5ecbe0fa-c2da-459e-a5e4-53cb4d466dfd tempest-ServersNegativeTestJSON-465113645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b078d4d5-2977-4c97-b352-838d14bd62e4" returned: 0 in 0.933s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:34 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5ecbe0fa-c2da-459e-a5e4-53cb4d466dfd tempest-ServersNegativeTestJSON-465113645 None] Lock "cinder-quobyte-b078d4d5-2977-4c97-b352-838d14bd62e4" released by "delete_volume" :: held 2.325s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:07:34 devstack sudo[84509]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-23bc3fdc-a953-4359-a682-cee2749d5ded tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.3c657da2-bc21-4089-b47c-2fe4a6036161" returned: 0 in 0.996s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:34 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-5ecbe0fa-c2da-459e-a5e4-53cb4d466dfd tempest-ServersNegativeTestJSON-465113645 None] Created reservations ['b0985ed2-8662-4dce-bcb8-f7f3e0d4ad04', 'f357acb4-d34b-4b13-8288-ec3fd1992e3d', 'dcbc6359-c2c0-46b7-8562-ea447dadf0a0', 'de3678ee-b52a-4021-8a4a-8751fc660d13'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:07:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-23bc3fdc-a953-4359-a682-cee2749d5ded tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:34 devstack sudo[84514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.info Apr 27 10:07:34 devstack sudo[84514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5ecbe0fa-c2da-459e-a5e4-53cb4d466dfd tempest-ServersNegativeTestJSON-465113645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5ecbe0fa-c2da-459e-a5e4-53cb4d466dfd tempest-ServersNegativeTestJSON-465113645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5ecbe0fa-c2da-459e-a5e4-53cb4d466dfd tempest-ServersNegativeTestJSON-465113645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:07:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5ecbe0fa-c2da-459e-a5e4-53cb4d466dfd tempest-ServersNegativeTestJSON-465113645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:07:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5ecbe0fa-c2da-459e-a5e4-53cb4d466dfd tempest-ServersNegativeTestJSON-465113645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5ecbe0fa-c2da-459e-a5e4-53cb4d466dfd tempest-ServersNegativeTestJSON-465113645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:34 devstack sudo[84516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:07:34 devstack sudo[84516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-69a40951-6c74-40bc-b5d9-0714ccc99dfb tempest-ServersNegativeTestJSON-465113645 None] Acquiring lock "cinder-77935a77-a8f5-495a-88a2-659a0700256e-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:07:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-69a40951-6c74-40bc-b5d9-0714ccc99dfb tempest-ServersNegativeTestJSON-465113645 None] Lock "cinder-77935a77-a8f5-495a-88a2-659a0700256e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:07:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-69a40951-6c74-40bc-b5d9-0714ccc99dfb tempest-ServersNegativeTestJSON-465113645 None] Acquiring lock "cinder-quobyte-77935a77-a8f5-495a-88a2-659a0700256e" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:07:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-69a40951-6c74-40bc-b5d9-0714ccc99dfb tempest-ServersNegativeTestJSON-465113645 None] Lock "cinder-quobyte-77935a77-a8f5-495a-88a2-659a0700256e" acquired by "delete_volume" :: waited 0.062s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:07:35 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ade30b0-6a57-48c7-82be-1944e7343605]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:07:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-69a40951-6c74-40bc-b5d9-0714ccc99dfb tempest-ServersNegativeTestJSON-465113645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-77935a77-a8f5-495a-88a2-659a0700256e {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:35 devstack sudo[84514]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-23bc3fdc-a953-4359-a682-cee2749d5ded tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.info" returned: 0 in 1.230s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:35 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-23bc3fdc-a953-4359-a682-cee2749d5ded tempest-VolumesSnapshotTestJSON-1648254463 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.info is being set with open permissions: ugo+rw Apr 27 10:07:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-23bc3fdc-a953-4359-a682-cee2749d5ded tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:35 devstack sudo[84584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-77935a77-a8f5-495a-88a2-659a0700256e Apr 27 10:07:35 devstack sudo[84584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:35 devstack sudo[84585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.info Apr 27 10:07:35 devstack sudo[84585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:36 devstack sudo[84516]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5ecbe0fa-c2da-459e-a5e4-53cb4d466dfd tempest-ServersNegativeTestJSON-465113645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 1.352s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:36 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-5ecbe0fa-c2da-459e-a5e4-53cb4d466dfd tempest-ServersNegativeTestJSON-465113645 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:07:36 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-5ecbe0fa-c2da-459e-a5e4-53cb4d466dfd tempest-ServersNegativeTestJSON-465113645 None] Deleted volume successfully. Apr 27 10:07:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5ecbe0fa-c2da-459e-a5e4-53cb4d466dfd tempest-ServersNegativeTestJSON-465113645 None] Lock "cinder-b078d4d5-2977-4c97-b352-838d14bd62e4-delete_volume" released by "delete_volume" :: held 4.244s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:07:36 devstack sudo[84585]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-23bc3fdc-a953-4359-a682-cee2749d5ded tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.info" returned: 0 in 0.785s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-23bc3fdc-a953-4359-a682-cee2749d5ded tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.454s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:36 devstack sudo[84584]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-69a40951-6c74-40bc-b5d9-0714ccc99dfb tempest-ServersNegativeTestJSON-465113645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-77935a77-a8f5-495a-88a2-659a0700256e" returned: 0 in 0.882s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-69a40951-6c74-40bc-b5d9-0714ccc99dfb tempest-ServersNegativeTestJSON-465113645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-77935a77-a8f5-495a-88a2-659a0700256e {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:36 devstack sudo[84596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-77935a77-a8f5-495a-88a2-659a0700256e Apr 27 10:07:36 devstack sudo[84596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:36 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-23bc3fdc-a953-4359-a682-cee2749d5ded tempest-VolumesSnapshotTestJSON-1648254463 None] Create snapshot completed successfully Apr 27 10:07:37 devstack sudo[84596]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-69a40951-6c74-40bc-b5d9-0714ccc99dfb tempest-ServersNegativeTestJSON-465113645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-77935a77-a8f5-495a-88a2-659a0700256e" returned: 0 in 0.612s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-69a40951-6c74-40bc-b5d9-0714ccc99dfb tempest-ServersNegativeTestJSON-465113645 None] Lock "cinder-quobyte-77935a77-a8f5-495a-88a2-659a0700256e" released by "delete_volume" :: held 1.640s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:07:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7f74f5ec-ef67-44a7-9e36-63a7bc578011 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "cinder-3c657da2-bc21-4089-b47c-2fe4a6036161-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:07:37 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-69a40951-6c74-40bc-b5d9-0714ccc99dfb tempest-ServersNegativeTestJSON-465113645 None] Created reservations ['a6d0e74e-33d5-47f4-a9c0-03ed393c0a2b', '381abf18-b866-4dc7-a074-886ec384dd12', 'a0f0914a-8626-4bec-874d-deb59b09824a', '6b455f5f-630e-41d3-ad6c-ed8a49218630'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:07:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7f74f5ec-ef67-44a7-9e36-63a7bc578011 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-3c657da2-bc21-4089-b47c-2fe4a6036161-delete_snapshot" acquired by "delete_snapshot" :: waited 0.097s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:07:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-69a40951-6c74-40bc-b5d9-0714ccc99dfb tempest-ServersNegativeTestJSON-465113645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-69a40951-6c74-40bc-b5d9-0714ccc99dfb tempest-ServersNegativeTestJSON-465113645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:37 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-69a40951-6c74-40bc-b5d9-0714ccc99dfb tempest-ServersNegativeTestJSON-465113645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:07:37 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-69a40951-6c74-40bc-b5d9-0714ccc99dfb tempest-ServersNegativeTestJSON-465113645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:07:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-69a40951-6c74-40bc-b5d9-0714ccc99dfb tempest-ServersNegativeTestJSON-465113645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-69a40951-6c74-40bc-b5d9-0714ccc99dfb tempest-ServersNegativeTestJSON-465113645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7f74f5ec-ef67-44a7-9e36-63a7bc578011 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "cinder-quobyte-8f1feb22-2fae-4023-bf35-8c6e0594943e" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:07:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7f74f5ec-ef67-44a7-9e36-63a7bc578011 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-8f1feb22-2fae-4023-bf35-8c6e0594943e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:07:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7f74f5ec-ef67-44a7-9e36-63a7bc578011 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "cinder-quobyte-3c657da2-bc21-4089-b47c-2fe4a6036161" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:07:37 devstack sudo[84628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:07:37 devstack sudo[84628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7f74f5ec-ef67-44a7-9e36-63a7bc578011 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-3c657da2-bc21-4089-b47c-2fe4a6036161" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:07:37 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-7f74f5ec-ef67-44a7-9e36-63a7bc578011 tempest-VolumesSnapshotTestJSON-1648254463 None] Deleting offline snapshot 3c657da2-bc21-4089-b47c-2fe4a6036161 of volume 8f1feb22-2fae-4023-bf35-8c6e0594943e {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:07:37 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-7f74f5ec-ef67-44a7-9e36-63a7bc578011 tempest-VolumesSnapshotTestJSON-1648254463 None] snapshot_file for this snap is: volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.3c657da2-bc21-4089-b47c-2fe4a6036161 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:07:37 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18fc7a5-bd39-4571-89df-c330a16947c3]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:07:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7f74f5ec-ef67-44a7-9e36-63a7bc578011 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.3c657da2-bc21-4089-b47c-2fe4a6036161 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:37 devstack sudo[84630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.3c657da2-bc21-4089-b47c-2fe4a6036161 Apr 27 10:07:37 devstack sudo[84630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:38 devstack sudo[84628]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-69a40951-6c74-40bc-b5d9-0714ccc99dfb tempest-ServersNegativeTestJSON-465113645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.581s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:38 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-69a40951-6c74-40bc-b5d9-0714ccc99dfb tempest-ServersNegativeTestJSON-465113645 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:07:38 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-69a40951-6c74-40bc-b5d9-0714ccc99dfb tempest-ServersNegativeTestJSON-465113645 None] Deleted volume successfully. Apr 27 10:07:38 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-69a40951-6c74-40bc-b5d9-0714ccc99dfb tempest-ServersNegativeTestJSON-465113645 None] Lock "cinder-77935a77-a8f5-495a-88a2-659a0700256e-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:07:38 devstack sudo[84630]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7f74f5ec-ef67-44a7-9e36-63a7bc578011 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.3c657da2-bc21-4089-b47c-2fe4a6036161" returned: 0 in 0.729s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:38 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-7f74f5ec-ef67-44a7-9e36-63a7bc578011 tempest-VolumesSnapshotTestJSON-1648254463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f1feb22-2fae-4023-bf35-8c6e0594943e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:07:38 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a54e94-d0f6-4be0-8f16-0c5fa5bbbeea]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:07:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7f74f5ec-ef67-44a7-9e36-63a7bc578011 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:38 devstack sudo[84638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e Apr 27 10:07:38 devstack sudo[84638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:39 devstack sudo[84638]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7f74f5ec-ef67-44a7-9e36-63a7bc578011 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e" returned: 0 in 0.755s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7f74f5ec-ef67-44a7-9e36-63a7bc578011 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.3c657da2-bc21-4089-b47c-2fe4a6036161 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:39 devstack sudo[84657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.3c657da2-bc21-4089-b47c-2fe4a6036161 Apr 27 10:07:39 devstack sudo[84657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:39 devstack sudo[84657]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7f74f5ec-ef67-44a7-9e36-63a7bc578011 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.3c657da2-bc21-4089-b47c-2fe4a6036161" returned: 0 in 0.762s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7f74f5ec-ef67-44a7-9e36-63a7bc578011 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.3c657da2-bc21-4089-b47c-2fe4a6036161 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:39 devstack sudo[84688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.3c657da2-bc21-4089-b47c-2fe4a6036161 Apr 27 10:07:39 devstack sudo[84688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:40 devstack sudo[84688]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7f74f5ec-ef67-44a7-9e36-63a7bc578011 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e.3c657da2-bc21-4089-b47c-2fe4a6036161" returned: 0 in 0.482s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:40 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7f74f5ec-ef67-44a7-9e36-63a7bc578011 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-3c657da2-bc21-4089-b47c-2fe4a6036161" released by "_delete_snapshot" :: held 2.833s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:07:40 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7f74f5ec-ef67-44a7-9e36-63a7bc578011 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-8f1feb22-2fae-4023-bf35-8c6e0594943e" released by "delete_snapshot" :: held 2.857s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:07:40 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-7f74f5ec-ef67-44a7-9e36-63a7bc578011 tempest-VolumesSnapshotTestJSON-1648254463 None] Created reservations ['eea21a4b-862a-4c99-8655-f926702c9501', '06d993f3-8590-4efc-bae2-97836922785c', '2e91c7b0-aea1-48b6-8571-ae3059e44cee', '49d8fa6f-642d-4db2-8b71-e088fefd3ade'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:07:40 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-7f74f5ec-ef67-44a7-9e36-63a7bc578011 tempest-VolumesSnapshotTestJSON-1648254463 None] Delete snapshot completed successfully. Apr 27 10:07:40 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7f74f5ec-ef67-44a7-9e36-63a7bc578011 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-3c657da2-bc21-4089-b47c-2fe4a6036161-delete_snapshot" released by "delete_snapshot" :: held 3.094s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:07:41 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:07:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Flow 'volume_create_manager' (6430efd6-98b6-464b-8100-0390da892395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:07:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18f0bf4-1032-45f1-a01a-a13d099552b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18f0bf4-1032-45f1-a01a-a13d099552b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1650264069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cc2f101-800a-4b50-b8d2-bae3d86f4708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a66e2922c547b68c14b3aca35d55bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:07:41Z,use_quota=True,user_id='9b4e8350433047bab63c9604cff72955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e86123-2047-4c3d-9cda-894162093155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e86123-2047-4c3d-9cda-894162093155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2445f7a8-33da-4018-92ca-505e4a20a314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2445f7a8-33da-4018-92ca-505e4a20a314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cc2f101-800a-4b50-b8d2-bae3d86f4708', 'volume_name': 'volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c7fc96f-52eb-4ef9-baf2-18ade72be189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c7fc96f-52eb-4ef9-baf2-18ade72be189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f6293d4-766c-471a-b647-19e74524f4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:41 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Volume 0cc2f101-800a-4b50-b8d2-bae3d86f4708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708', 'volume_size': 1} Apr 27 10:07:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1650264069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cc2f101-800a-4b50-b8d2-bae3d86f4708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a66e2922c547b68c14b3aca35d55bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:07:41Z,use_quota=True,user_id='9b4e8350433047bab63c9604cff72955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:07:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Creating volume 0cc2f101-800a-4b50-b8d2-bae3d86f4708 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:07:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:07:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:07:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:07:41 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:07:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:41 devstack sudo[84695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 1073741824 Apr 27 10:07:41 devstack sudo[84695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:41 devstack sudo[84695]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 1073741824" returned: 0 in 0.639s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:41 devstack sudo[84700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 Apr 27 10:07:41 devstack sudo[84700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:42 devstack sudo[84700]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708" returned: 0 in 0.504s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:42 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:07:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:42 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f6293d4-766c-471a-b647-19e74524f4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:42 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12abf6a7-61e8-4b9a-9853-12f6d8c0a34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:42 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Volume volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 (0cc2f101-800a-4b50-b8d2-bae3d86f4708): created successfully Apr 27 10:07:42 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12abf6a7-61e8-4b9a-9853-12f6d8c0a34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:42 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Flow 'volume_create_manager' (6430efd6-98b6-464b-8100-0390da892395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:07:42 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-5dba63fc-03af-4691-a043-e1680b6e744e tempest-VolumesSnapshotTestJSON-1648254463 None] Created volume successfully. Apr 27 10:07:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-727d1b83-a929-41dc-966e-68b7b4118909 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-727d1b83-a929-41dc-966e-68b7b4118909 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:43 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-727d1b83-a929-41dc-966e-68b7b4118909 tempest-VolumesSnapshotTestJSON-1648254463 None] Creating offline snapshot 9e219ff5-502e-46bc-a948-6aab49df4b06 of volume 0cc2f101-800a-4b50-b8d2-bae3d86f4708 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:07:43 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[21262839-ff90-487a-a075-f59eb49e0ce1]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:07:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-727d1b83-a929-41dc-966e-68b7b4118909 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:43 devstack sudo[84704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 Apr 27 10:07:43 devstack sudo[84704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:44 devstack sudo[84704]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-727d1b83-a929-41dc-966e-68b7b4118909 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708" returned: 0 in 0.642s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-727d1b83-a929-41dc-966e-68b7b4118909 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.9e219ff5-502e-46bc-a948-6aab49df4b06 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:44 devstack sudo[84710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.9e219ff5-502e-46bc-a948-6aab49df4b06 1G Apr 27 10:07:44 devstack sudo[84710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:44 devstack sudo[84710]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-727d1b83-a929-41dc-966e-68b7b4118909 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.9e219ff5-502e-46bc-a948-6aab49df4b06 1G" returned: 0 in 0.792s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-727d1b83-a929-41dc-966e-68b7b4118909 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.9e219ff5-502e-46bc-a948-6aab49df4b06 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:44 devstack sudo[84716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.9e219ff5-502e-46bc-a948-6aab49df4b06 Apr 27 10:07:44 devstack sudo[84716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:45 devstack sudo[84716]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-727d1b83-a929-41dc-966e-68b7b4118909 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.9e219ff5-502e-46bc-a948-6aab49df4b06" returned: 0 in 0.625s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:45 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-727d1b83-a929-41dc-966e-68b7b4118909 tempest-VolumesSnapshotTestJSON-1648254463 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.9e219ff5-502e-46bc-a948-6aab49df4b06 is being set with open permissions: ugo+rw Apr 27 10:07:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-727d1b83-a929-41dc-966e-68b7b4118909 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.9e219ff5-502e-46bc-a948-6aab49df4b06 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:45 devstack sudo[84721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.9e219ff5-502e-46bc-a948-6aab49df4b06 Apr 27 10:07:45 devstack sudo[84721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:46 devstack sudo[84721]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-727d1b83-a929-41dc-966e-68b7b4118909 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.9e219ff5-502e-46bc-a948-6aab49df4b06" returned: 0 in 0.701s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-727d1b83-a929-41dc-966e-68b7b4118909 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:46 devstack sudo[84725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.info Apr 27 10:07:46 devstack sudo[84725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:46 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:07:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Flow 'volume_create_manager' (fbb8a57c-4d83-44a4-ae99-c0efe0174cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:07:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0dfd97-4264-4f38-bf46-db9870a0a455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0dfd97-4264-4f38-bf46-db9870a0a455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:07:46Z,deleted=False,deleted_at=None,display_description='',display_name='b65ccd1b-8f36-47ae-8c29-523b7b7dbd03-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa06ea4-c4ee-426d-8bcf-1be897461a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7745614c785f4446ae5e26e4ac4b0644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:07:46Z,use_quota=True,user_id='0ff7d28488cd45a3924a8cc6ed95a14e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7dd169-58ce-4b5b-a6ef-9e5786759228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7dd169-58ce-4b5b-a6ef-9e5786759228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97959069-b61a-4701-a46a-440d8e98a69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97959069-b61a-4701-a46a-440d8e98a69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfa06ea4-c4ee-426d-8bcf-1be897461a05', 'volume_name': 'volume-dfa06ea4-c4ee-426d-8bcf-1be897461a05', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dcaf676-9f81-45a5-a2d9-448aa9fdd515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dcaf676-9f81-45a5-a2d9-448aa9fdd515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7efe88-d7e1-4bc1-9c51-05f7c5848007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:46 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Volume dfa06ea4-c4ee-426d-8bcf-1be897461a05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfa06ea4-c4ee-426d-8bcf-1be897461a05', 'volume_size': 1} Apr 27 10:07:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:47 devstack sudo[84725]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-727d1b83-a929-41dc-966e-68b7b4118909 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.info" returned: 0 in 0.718s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:47 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-727d1b83-a929-41dc-966e-68b7b4118909 tempest-VolumesSnapshotTestJSON-1648254463 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.info is being set with open permissions: ugo+rw Apr 27 10:07:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-727d1b83-a929-41dc-966e-68b7b4118909 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:47 devstack sudo[84730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.info Apr 27 10:07:47 devstack sudo[84730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:47 devstack sudo[84730]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-727d1b83-a929-41dc-966e-68b7b4118909 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.info" returned: 0 in 0.543s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-727d1b83-a929-41dc-966e-68b7b4118909 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.178s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.106s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:47 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:07:46Z,deleted=False,deleted_at=None,display_description='',display_name='b65ccd1b-8f36-47ae-8c29-523b7b7dbd03-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa06ea4-c4ee-426d-8bcf-1be897461a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7745614c785f4446ae5e26e4ac4b0644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:07:46Z,use_quota=True,user_id='0ff7d28488cd45a3924a8cc6ed95a14e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:07:47 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Creating volume dfa06ea4-c4ee-426d-8bcf-1be897461a05 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:07:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:47 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:07:47 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:07:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:47 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:07:47 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:07:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfa06ea4-c4ee-426d-8bcf-1be897461a05 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:47 devstack sudo[84733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfa06ea4-c4ee-426d-8bcf-1be897461a05 1073741824 Apr 27 10:07:47 devstack sudo[84733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:47 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-727d1b83-a929-41dc-966e-68b7b4118909 tempest-VolumesSnapshotTestJSON-1648254463 None] Create snapshot completed successfully Apr 27 10:07:48 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:07:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Flow 'volume_create_manager' (5d3e03c3-f942-4814-8c0e-4a22d767773e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:07:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9dd7e3-b9ac-4b6d-8438-28f73b4bef38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9dd7e3-b9ac-4b6d-8438-28f73b4bef38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1862050133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a66e2922c547b68c14b3aca35d55bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:07:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=9e219ff5-502e-46bc-a948-6aab49df4b06,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:07:48Z,use_quota=True,user_id='9b4e8350433047bab63c9604cff72955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2706b044-0128-4d1f-afb5-73459edba3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2706b044-0128-4d1f-afb5-73459edba3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06efc63b-8254-469d-b148-30ea18aef6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06efc63b-8254-469d-b148-30ea18aef6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e', 'volume_name': 'volume-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e', 'volume_size': 2, 'snapshot_id': '9e219ff5-502e-46bc-a948-6aab49df4b06'}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35eeb424-c838-405c-84fc-e3d19a84fca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35eeb424-c838-405c-84fc-e3d19a84fca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b60efdcd-660c-4084-9fc6-2e3b66389849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:48 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Volume dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e', 'volume_size': 2, 'snapshot_id': '9e219ff5-502e-46bc-a948-6aab49df4b06'} Apr 27 10:07:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:48 devstack sudo[84733]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfa06ea4-c4ee-426d-8bcf-1be897461a05 1073741824" returned: 0 in 0.957s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfa06ea4-c4ee-426d-8bcf-1be897461a05 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:48 devstack sudo[84739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfa06ea4-c4ee-426d-8bcf-1be897461a05 Apr 27 10:07:48 devstack sudo[84739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:49 devstack sudo[84739]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfa06ea4-c4ee-426d-8bcf-1be897461a05" returned: 0 in 0.569s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.661s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "cinder-quobyte-9e219ff5-502e-46bc-a948-6aab49df4b06-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e" by "_create_volume_from_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7efe88-d7e1-4bc1-9c51-05f7c5848007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfa06ea4-c4ee-426d-8bcf-1be897461a05', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed55a931-e3ff-4cda-af1b-b03a7fcedce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-9e219ff5-502e-46bc-a948-6aab49df4b06-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Creating volume dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e from snapshot 9e219ff5-502e-46bc-a948-6aab49df4b06 {{(pid=81350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "cinder-quobyte-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e" by "_copy_volume_from_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:07:49 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Volume volume-dfa06ea4-c4ee-426d-8bcf-1be897461a05 (dfa06ea4-c4ee-426d-8bcf-1be897461a05): created successfully Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed55a931-e3ff-4cda-af1b-b03a7fcedce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Flow 'volume_create_manager' (fbb8a57c-4d83-44a4-ae99-c0efe0174cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e" acquired by "_copy_volume_from_snapshot" :: waited 0.059s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] snapshot: 9e219ff5-502e-46bc-a948-6aab49df4b06, volume: dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e, {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 27 10:07:49 devstack cinder-volume[81350]: INFO cinder.volume.manager [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-fbeca432-6e9e-4623-a6d7-cc5ebed4c027 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Created volume successfully. Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c907b3-8769-493b-8caa-37222e11d6ba]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.9e219ff5-502e-46bc-a948-6aab49df4b06 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:49 devstack sudo[84742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.9e219ff5-502e-46bc-a948-6aab49df4b06 Apr 27 10:07:49 devstack sudo[84742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Flow 'volume_create_manager' (0f009254-66f4-4339-8936-0c658cb2459d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c8d2164-9c8c-43a1-85d1-5b0e05710196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c8d2164-9c8c-43a1-85d1-5b0e05710196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1734583228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3810cc7-efc6-473b-b580-3d4ff4f069a5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='381d6e041b584606b1b83abde79b0d09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:07:50Z,use_quota=True,user_id='0556e37d87d84ce4baa62e3bc549bdc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1df6e170-198c-4d5c-8d57-6941a6a28269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1df6e170-198c-4d5c-8d57-6941a6a28269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3c25a4a-cc13-496f-9c42-7d6b8a75e641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3c25a4a-cc13-496f-9c42-7d6b8a75e641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3810cc7-efc6-473b-b580-3d4ff4f069a5', 'volume_name': 'volume-b3810cc7-efc6-473b-b580-3d4ff4f069a5', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318c4459-100a-48dc-befb-8b3195fb3d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318c4459-100a-48dc-befb-8b3195fb3d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a67df9-2af0-4ed0-8851-27b8b3f2bceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:49 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Volume b3810cc7-efc6-473b-b580-3d4ff4f069a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3810cc7-efc6-473b-b580-3d4ff4f069a5', 'volume_size': 1} Apr 27 10:07:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-efca6d44-c8ef-4502-8576-190878683611 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:50 devstack sudo[84742]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.9e219ff5-502e-46bc-a948-6aab49df4b06" returned: 0 in 0.844s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:50 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:07:50 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 27 10:07:50 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Creating direct copy from snapshot {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 27 10:07:50 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ca8366-4025-4165-bf4d-fd6f2e1920ab]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:07:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:50 devstack sudo[84755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 Apr 27 10:07:50 devstack sudo[84755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:50 devstack sudo[84755]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708" returned: 0 in 0.661s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:50 devstack cinder-volume[81350]: DEBUG cinder.utils [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Path /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e not found in is_blk_device check {{(pid=81350) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 27 10:07:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:50 devstack sudo[84761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e Apr 27 10:07:50 devstack sudo[84761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:56 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:07:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Flow 'volume_create_manager' (c09487bc-3aae-4d87-98f3-3b1982373b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:07:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4f6ed0-712d-4465-857a-f5f7a56ec74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4f6ed0-712d-4465-857a-f5f7a56ec74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-948232650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05088c3-8c85-4b79-8b04-b1f91cb678b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9ea387164b14d2588d7a35981ee611e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:07:56Z,use_quota=True,user_id='d2faa26c97c2401db72e9a0a719389f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ac16905-4d09-42ae-8623-87c02d890908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ac16905-4d09-42ae-8623-87c02d890908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3bd4257-770e-4b09-bdf3-95ca89adb2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3bd4257-770e-4b09-bdf3-95ca89adb2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a05088c3-8c85-4b79-8b04-b1f91cb678b1', 'volume_name': 'volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (477e40c4-a0fa-4d9d-a147-c82a3e706a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (477e40c4-a0fa-4d9d-a147-c82a3e706a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098f670a-e2e8-4665-b420-987fab774bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:56 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Volume a05088c3-8c85-4b79-8b04-b1f91cb678b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1', 'volume_size': 1} Apr 27 10:07:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:56 devstack sudo[84761]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e" returned: 0 in 5.758s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:56 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91615c7-b614-4fcc-a61a-21a9b9f64413]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:07:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:56 devstack sudo[84808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 Apr 27 10:07:56 devstack sudo[84808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:57 devstack sudo[84808]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708" returned: 0 in 0.653s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:57 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Image conversion details: src /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e {{(pid=81350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 10:07:57 devstack cinder-volume[81350]: INFO cinder.image.image_utils [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Converted 1024.00 MB image at 177.78 MB/s Apr 27 10:07:57 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e is being set with open permissions: ugo+rw Apr 27 10:07:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:57 devstack sudo[84813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e Apr 27 10:07:57 devstack sudo[84813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:57 devstack sudo[84813]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e" returned: 0 in 0.413s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:57 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e" released by "_copy_volume_from_snapshot" :: held 8.442s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:07:57 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-9e219ff5-502e-46bc-a948-6aab49df4b06-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e" released by "_create_volume_from_snapshot" :: held 8.537s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:07:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.580s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.831s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1734583228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3810cc7-efc6-473b-b580-3d4ff4f069a5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='381d6e041b584606b1b83abde79b0d09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:07:50Z,use_quota=True,user_id='0556e37d87d84ce4baa62e3bc549bdc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:07:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Creating volume b3810cc7-efc6-473b-b580-3d4ff4f069a5 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:07:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:07:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:07:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:07:57 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:07:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b3810cc7-efc6-473b-b580-3d4ff4f069a5 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:57 devstack sudo[84816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b3810cc7-efc6-473b-b580-3d4ff4f069a5 1073741824 Apr 27 10:07:57 devstack sudo[84816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b60efdcd-660c-4084-9fc6-2e3b66389849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e', 'volume_size': 2, 'snapshot_id': '9e219ff5-502e-46bc-a948-6aab49df4b06'}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c27cf95c-4e71-42c2-8d08-9e60fd68af4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:57 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Volume volume-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e (dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e): created successfully Apr 27 10:07:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c27cf95c-4e71-42c2-8d08-9e60fd68af4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Flow 'volume_create_manager' (5d3e03c3-f942-4814-8c0e-4a22d767773e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:07:57 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-25c016b0-95b6-4894-92dc-6a4d6d5fcb4b tempest-VolumesSnapshotTestJSON-1648254463 None] Created volume successfully. Apr 27 10:07:58 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-118dd5a7-f104-48d7-8129-631d970791c6 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "cinder-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:07:58 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-118dd5a7-f104-48d7-8129-631d970791c6 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:07:58 devstack sudo[84816]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b3810cc7-efc6-473b-b580-3d4ff4f069a5 1073741824" returned: 0 in 0.683s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:58 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-118dd5a7-f104-48d7-8129-631d970791c6 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "cinder-quobyte-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:07:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b3810cc7-efc6-473b-b580-3d4ff4f069a5 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:58 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-118dd5a7-f104-48d7-8129-631d970791c6 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e" acquired by "delete_volume" :: waited 0.029s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:07:58 devstack sudo[84821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b3810cc7-efc6-473b-b580-3d4ff4f069a5 Apr 27 10:07:58 devstack sudo[84821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:58 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a498fcd-b9bf-4c6f-95c7-eec8fcacff7a]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:07:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-118dd5a7-f104-48d7-8129-631d970791c6 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:58 devstack sudo[84823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e Apr 27 10:07:58 devstack sudo[84823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:58 devstack sudo[84821]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b3810cc7-efc6-473b-b580-3d4ff4f069a5" returned: 0 in 0.438s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-efca6d44-c8ef-4502-8576-190878683611 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.960s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a67df9-2af0-4ed0-8851-27b8b3f2bceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3810cc7-efc6-473b-b580-3d4ff4f069a5', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17327ac4-91c4-4be8-adf1-5424ad8f0870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccb213b-1498-4d12-82c1-51dec97d5854]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-efca6d44-c8ef-4502-8576-190878683611 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfa06ea4-c4ee-426d-8bcf-1be897461a05 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:59 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Volume volume-b3810cc7-efc6-473b-b580-3d4ff4f069a5 (b3810cc7-efc6-473b-b580-3d4ff4f069a5): created successfully Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17327ac4-91c4-4be8-adf1-5424ad8f0870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Flow 'volume_create_manager' (0f009254-66f4-4339-8936-0c658cb2459d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:07:59 devstack cinder-volume[81350]: INFO cinder.volume.manager [req-0cad94a8-5722-47ce-b307-19cad53af07f req-06bda931-1f7d-416e-891f-f9185c3556bb tempest-VolumesGetTestJSON-1707312934 None] Created volume successfully. Apr 27 10:07:59 devstack sudo[84829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfa06ea4-c4ee-426d-8bcf-1be897461a05 Apr 27 10:07:59 devstack sudo[84823]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:59 devstack sudo[84829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-118dd5a7-f104-48d7-8129-631d970791c6 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e" returned: 0 in 0.517s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-118dd5a7-f104-48d7-8129-631d970791c6 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:59 devstack sudo[84831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e Apr 27 10:07:59 devstack sudo[84831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-7b708924-460c-4b80-ba09-ce1810fb06ef req-27e99860-7c9b-413f-beab-6ab06e40b1c9 tempest-VolumesGetTestJSON-1707312934 None] Acquiring lock "cinder-b3810cc7-efc6-473b-b580-3d4ff4f069a5-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-7b708924-460c-4b80-ba09-ce1810fb06ef req-27e99860-7c9b-413f-beab-6ab06e40b1c9 tempest-VolumesGetTestJSON-1707312934 None] Lock "cinder-b3810cc7-efc6-473b-b580-3d4ff4f069a5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-7b708924-460c-4b80-ba09-ce1810fb06ef req-27e99860-7c9b-413f-beab-6ab06e40b1c9 tempest-VolumesGetTestJSON-1707312934 None] Acquiring lock "cinder-quobyte-b3810cc7-efc6-473b-b580-3d4ff4f069a5" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-7b708924-460c-4b80-ba09-ce1810fb06ef req-27e99860-7c9b-413f-beab-6ab06e40b1c9 tempest-VolumesGetTestJSON-1707312934 None] Lock "cinder-quobyte-b3810cc7-efc6-473b-b580-3d4ff4f069a5" acquired by "delete_volume" :: waited 0.014s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c15ab15-795c-47db-bd62-196d11d19cf6]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-7b708924-460c-4b80-ba09-ce1810fb06ef req-27e99860-7c9b-413f-beab-6ab06e40b1c9 tempest-VolumesGetTestJSON-1707312934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b3810cc7-efc6-473b-b580-3d4ff4f069a5 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:59 devstack sudo[84833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b3810cc7-efc6-473b-b580-3d4ff4f069a5 Apr 27 10:07:59 devstack sudo[84833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:59 devstack sudo[84829]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-efca6d44-c8ef-4502-8576-190878683611 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfa06ea4-c4ee-426d-8bcf-1be897461a05" returned: 0 in 0.709s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-efca6d44-c8ef-4502-8576-190878683611 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.733s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.600s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-948232650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05088c3-8c85-4b79-8b04-b1f91cb678b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9ea387164b14d2588d7a35981ee611e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:07:56Z,use_quota=True,user_id='d2faa26c97c2401db72e9a0a719389f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Creating volume a05088c3-8c85-4b79-8b04-b1f91cb678b1 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:07:59 devstack sudo[84831]: pam_unix(sudo:session): session closed for user root Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:07:59 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-118dd5a7-f104-48d7-8129-631d970791c6 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e" returned: 0 in 0.644s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:07:59 devstack sudo[84839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1 1073741824 Apr 27 10:07:59 devstack sudo[84839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-118dd5a7-f104-48d7-8129-631d970791c6 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e" released by "delete_volume" :: held 1.205s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-efca6d44-c8ef-4502-8576-190878683611 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4', 'name': 'volume-dfa06ea4-c4ee-426d-8bcf-1be897461a05', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0271d22c-f403-4676-baa7-89f17e38a852', 'enforce_multipath': True} {{(pid=81350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-118dd5a7-f104-48d7-8129-631d970791c6 tempest-VolumesSnapshotTestJSON-1648254463 None] Created reservations ['4bbc2d94-8ee0-46fa-84a8-46ced256f969', '1ab65e60-b88c-4a5d-9434-d4c654dda029', 'ef5ae2f7-ae5f-45a8-bfc8-4871207980e1', '07845e18-d1d1-4240-ac50-fb97d9d9ccb8'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:07:59 devstack cinder-volume[81350]: INFO cinder.volume.manager [req-9ec95fa9-38be-4e2f-9a36-915976106c75 req-efca6d44-c8ef-4502-8576-190878683611 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] attachment_update completed successfully. Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-118dd5a7-f104-48d7-8129-631d970791c6 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-118dd5a7-f104-48d7-8129-631d970791c6 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-118dd5a7-f104-48d7-8129-631d970791c6 tempest-VolumesSnapshotTestJSON-1648254463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-118dd5a7-f104-48d7-8129-631d970791c6 tempest-VolumesSnapshotTestJSON-1648254463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-118dd5a7-f104-48d7-8129-631d970791c6 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:07:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-118dd5a7-f104-48d7-8129-631d970791c6 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:07:59 devstack sudo[84841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:07:59 devstack sudo[84841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:00 devstack sudo[84833]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-7b708924-460c-4b80-ba09-ce1810fb06ef req-27e99860-7c9b-413f-beab-6ab06e40b1c9 tempest-VolumesGetTestJSON-1707312934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b3810cc7-efc6-473b-b580-3d4ff4f069a5" returned: 0 in 0.663s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-7b708924-460c-4b80-ba09-ce1810fb06ef req-27e99860-7c9b-413f-beab-6ab06e40b1c9 tempest-VolumesGetTestJSON-1707312934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b3810cc7-efc6-473b-b580-3d4ff4f069a5 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:00 devstack sudo[84849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b3810cc7-efc6-473b-b580-3d4ff4f069a5 Apr 27 10:08:00 devstack sudo[84849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:00 devstack sudo[84839]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1 1073741824" returned: 0 in 0.637s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:00 devstack sudo[84841]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-118dd5a7-f104-48d7-8129-631d970791c6 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.527s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:00 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-118dd5a7-f104-48d7-8129-631d970791c6 tempest-VolumesSnapshotTestJSON-1648254463 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:08:00 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-118dd5a7-f104-48d7-8129-631d970791c6 tempest-VolumesSnapshotTestJSON-1648254463 None] Deleted volume successfully. Apr 27 10:08:00 devstack sudo[84852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1 Apr 27 10:08:00 devstack sudo[84852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-118dd5a7-f104-48d7-8129-631d970791c6 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-dfdf7cea-28ed-49cc-85b1-a0ccffc4cd4e-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e6a9f7b1-7d9a-43bc-b27c-a1243e5f9ce9 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "cinder-9e219ff5-502e-46bc-a948-6aab49df4b06-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e6a9f7b1-7d9a-43bc-b27c-a1243e5f9ce9 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-9e219ff5-502e-46bc-a948-6aab49df4b06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e6a9f7b1-7d9a-43bc-b27c-a1243e5f9ce9 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "cinder-quobyte-0cc2f101-800a-4b50-b8d2-bae3d86f4708" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e6a9f7b1-7d9a-43bc-b27c-a1243e5f9ce9 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-0cc2f101-800a-4b50-b8d2-bae3d86f4708" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e6a9f7b1-7d9a-43bc-b27c-a1243e5f9ce9 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "cinder-quobyte-9e219ff5-502e-46bc-a948-6aab49df4b06" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e6a9f7b1-7d9a-43bc-b27c-a1243e5f9ce9 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-9e219ff5-502e-46bc-a948-6aab49df4b06" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:00 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-e6a9f7b1-7d9a-43bc-b27c-a1243e5f9ce9 tempest-VolumesSnapshotTestJSON-1648254463 None] Deleting offline snapshot 9e219ff5-502e-46bc-a948-6aab49df4b06 of volume 0cc2f101-800a-4b50-b8d2-bae3d86f4708 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:08:00 devstack sudo[84849]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:00 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-e6a9f7b1-7d9a-43bc-b27c-a1243e5f9ce9 tempest-VolumesSnapshotTestJSON-1648254463 None] snapshot_file for this snap is: volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.9e219ff5-502e-46bc-a948-6aab49df4b06 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:08:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-7b708924-460c-4b80-ba09-ce1810fb06ef req-27e99860-7c9b-413f-beab-6ab06e40b1c9 tempest-VolumesGetTestJSON-1707312934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b3810cc7-efc6-473b-b580-3d4ff4f069a5" returned: 0 in 0.662s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:00 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[964608ae-a59b-450c-9ae0-a82586363662]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e6a9f7b1-7d9a-43bc-b27c-a1243e5f9ce9 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.9e219ff5-502e-46bc-a948-6aab49df4b06 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-7b708924-460c-4b80-ba09-ce1810fb06ef req-27e99860-7c9b-413f-beab-6ab06e40b1c9 tempest-VolumesGetTestJSON-1707312934 None] Lock "cinder-quobyte-b3810cc7-efc6-473b-b580-3d4ff4f069a5" released by "delete_volume" :: held 1.381s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:00 devstack cinder-volume[81350]: DEBUG cinder.quota [req-7b708924-460c-4b80-ba09-ce1810fb06ef req-27e99860-7c9b-413f-beab-6ab06e40b1c9 tempest-VolumesGetTestJSON-1707312934 None] Created reservations ['2d4dc4f0-24e1-4da5-a0a9-eac1aa88875f', '741c8aae-5a25-4e3b-b457-b18ce63876a3', '25dbc3fa-82a8-4134-8913-0cd3de95e209', '3c9e2a65-727a-4f7a-a8d2-47f7ce3b6848'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:08:01 devstack sudo[84856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.9e219ff5-502e-46bc-a948-6aab49df4b06 Apr 27 10:08:01 devstack sudo[84856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:01 devstack sudo[84852]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1" returned: 0 in 0.606s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:08:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:01 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098f670a-e2e8-4665-b420-987fab774bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:01 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19eb86e8-ed52-4cc7-bbe9-565c3593c7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:01 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Volume volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1 (a05088c3-8c85-4b79-8b04-b1f91cb678b1): created successfully Apr 27 10:08:01 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19eb86e8-ed52-4cc7-bbe9-565c3593c7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:01 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Flow 'volume_create_manager' (c09487bc-3aae-4d87-98f3-3b1982373b4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:08:01 devstack cinder-volume[81350]: INFO cinder.volume.manager [req-9bb45794-84ca-4618-b500-e8c61782fa18 req-044cd99d-59bc-44f4-b3b6-f7f15f744ad0 tempest-VolumesSnapshotsTestJSON-177043574 None] Created volume successfully. Apr 27 10:08:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-7b708924-460c-4b80-ba09-ce1810fb06ef req-27e99860-7c9b-413f-beab-6ab06e40b1c9 tempest-VolumesGetTestJSON-1707312934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-7b708924-460c-4b80-ba09-ce1810fb06ef req-27e99860-7c9b-413f-beab-6ab06e40b1c9 tempest-VolumesGetTestJSON-1707312934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-7b708924-460c-4b80-ba09-ce1810fb06ef req-27e99860-7c9b-413f-beab-6ab06e40b1c9 tempest-VolumesGetTestJSON-1707312934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:08:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-7b708924-460c-4b80-ba09-ce1810fb06ef req-27e99860-7c9b-413f-beab-6ab06e40b1c9 tempest-VolumesGetTestJSON-1707312934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:08:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-7b708924-460c-4b80-ba09-ce1810fb06ef req-27e99860-7c9b-413f-beab-6ab06e40b1c9 tempest-VolumesGetTestJSON-1707312934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-7b708924-460c-4b80-ba09-ce1810fb06ef req-27e99860-7c9b-413f-beab-6ab06e40b1c9 tempest-VolumesGetTestJSON-1707312934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:01 devstack sudo[84858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:08:01 devstack sudo[84858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:01 devstack sudo[84856]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e6a9f7b1-7d9a-43bc-b27c-a1243e5f9ce9 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.9e219ff5-502e-46bc-a948-6aab49df4b06" returned: 0 in 0.569s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-e6a9f7b1-7d9a-43bc-b27c-a1243e5f9ce9 tempest-VolumesSnapshotTestJSON-1648254463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:08:01 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d846dc37-cce7-4d50-b564-e305c130e3d2]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e6a9f7b1-7d9a-43bc-b27c-a1243e5f9ce9 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:01 devstack sudo[84858]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-7b708924-460c-4b80-ba09-ce1810fb06ef req-27e99860-7c9b-413f-beab-6ab06e40b1c9 tempest-VolumesGetTestJSON-1707312934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.458s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:01 devstack cinder-volume[81350]: DEBUG cinder.manager [req-7b708924-460c-4b80-ba09-ce1810fb06ef req-27e99860-7c9b-413f-beab-6ab06e40b1c9 tempest-VolumesGetTestJSON-1707312934 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:08:01 devstack cinder-volume[81350]: INFO cinder.volume.manager [req-7b708924-460c-4b80-ba09-ce1810fb06ef req-27e99860-7c9b-413f-beab-6ab06e40b1c9 tempest-VolumesGetTestJSON-1707312934 None] Deleted volume successfully. Apr 27 10:08:01 devstack sudo[84864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 Apr 27 10:08:01 devstack sudo[84864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:01 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-7b708924-460c-4b80-ba09-ce1810fb06ef req-27e99860-7c9b-413f-beab-6ab06e40b1c9 tempest-VolumesGetTestJSON-1707312934 None] Lock "cinder-b3810cc7-efc6-473b-b580-3d4ff4f069a5-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-26eaac03-cb2c-46ed-984c-b078dbb70025 req-621e8628-4d13-4850-8a24-0037bf78fd54 tempest-VolumesSnapshotsTestJSON-177043574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-26eaac03-cb2c-46ed-984c-b078dbb70025 req-621e8628-4d13-4850-8a24-0037bf78fd54 tempest-VolumesSnapshotsTestJSON-177043574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [req-26eaac03-cb2c-46ed-984c-b078dbb70025 req-621e8628-4d13-4850-8a24-0037bf78fd54 tempest-VolumesSnapshotsTestJSON-177043574 None] Creating offline snapshot 48f31915-355e-431b-afa1-5a37d9e8fed1 of volume a05088c3-8c85-4b79-8b04-b1f91cb678b1 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:08:02 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a03953-a6c7-45e4-9510-8641c2046f1a]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-26eaac03-cb2c-46ed-984c-b078dbb70025 req-621e8628-4d13-4850-8a24-0037bf78fd54 tempest-VolumesSnapshotsTestJSON-177043574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:02 devstack sudo[84864]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e6a9f7b1-7d9a-43bc-b27c-a1243e5f9ce9 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708" returned: 0 in 0.816s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e6a9f7b1-7d9a-43bc-b27c-a1243e5f9ce9 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.9e219ff5-502e-46bc-a948-6aab49df4b06 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:02 devstack sudo[84937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.9e219ff5-502e-46bc-a948-6aab49df4b06 Apr 27 10:08:02 devstack sudo[84937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:02 devstack sudo[84936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1 Apr 27 10:08:02 devstack sudo[84936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:03 devstack sudo[84937]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e6a9f7b1-7d9a-43bc-b27c-a1243e5f9ce9 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.9e219ff5-502e-46bc-a948-6aab49df4b06" returned: 0 in 0.831s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e6a9f7b1-7d9a-43bc-b27c-a1243e5f9ce9 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.9e219ff5-502e-46bc-a948-6aab49df4b06 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:03 devstack sudo[84950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.9e219ff5-502e-46bc-a948-6aab49df4b06 Apr 27 10:08:03 devstack sudo[84950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:03 devstack sudo[84936]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-26eaac03-cb2c-46ed-984c-b078dbb70025 req-621e8628-4d13-4850-8a24-0037bf78fd54 tempest-VolumesSnapshotsTestJSON-177043574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1" returned: 0 in 0.957s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-26eaac03-cb2c-46ed-984c-b078dbb70025 req-621e8628-4d13-4850-8a24-0037bf78fd54 tempest-VolumesSnapshotsTestJSON-177043574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.48f31915-355e-431b-afa1-5a37d9e8fed1 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:03 devstack sudo[84952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.48f31915-355e-431b-afa1-5a37d9e8fed1 1G Apr 27 10:08:03 devstack sudo[84952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:03 devstack sudo[84950]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e6a9f7b1-7d9a-43bc-b27c-a1243e5f9ce9 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708.9e219ff5-502e-46bc-a948-6aab49df4b06" returned: 0 in 0.650s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:03 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e6a9f7b1-7d9a-43bc-b27c-a1243e5f9ce9 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-9e219ff5-502e-46bc-a948-6aab49df4b06" released by "_delete_snapshot" :: held 2.983s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:03 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e6a9f7b1-7d9a-43bc-b27c-a1243e5f9ce9 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-0cc2f101-800a-4b50-b8d2-bae3d86f4708" released by "delete_snapshot" :: held 3.006s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:03 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-e6a9f7b1-7d9a-43bc-b27c-a1243e5f9ce9 tempest-VolumesSnapshotTestJSON-1648254463 None] Created reservations ['b6273af8-4a3f-4321-8842-3b4a41f29435', '108af929-f5b3-4d80-8729-540867d40a96', '1235cc24-0e1b-4006-937d-cb73fda07f57', '46c22c5e-518c-4697-995c-653ac8a7688e'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:08:04 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-e6a9f7b1-7d9a-43bc-b27c-a1243e5f9ce9 tempest-VolumesSnapshotTestJSON-1648254463 None] Delete snapshot completed successfully. Apr 27 10:08:04 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e6a9f7b1-7d9a-43bc-b27c-a1243e5f9ce9 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-9e219ff5-502e-46bc-a948-6aab49df4b06-delete_snapshot" released by "delete_snapshot" :: held 3.172s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:04 devstack sudo[84952]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-26eaac03-cb2c-46ed-984c-b078dbb70025 req-621e8628-4d13-4850-8a24-0037bf78fd54 tempest-VolumesSnapshotsTestJSON-177043574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.48f31915-355e-431b-afa1-5a37d9e8fed1 1G" returned: 0 in 0.922s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-26eaac03-cb2c-46ed-984c-b078dbb70025 req-621e8628-4d13-4850-8a24-0037bf78fd54 tempest-VolumesSnapshotsTestJSON-177043574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.48f31915-355e-431b-afa1-5a37d9e8fed1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:04 devstack sudo[84958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.48f31915-355e-431b-afa1-5a37d9e8fed1 Apr 27 10:08:04 devstack sudo[84958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:04 devstack sudo[84958]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-26eaac03-cb2c-46ed-984c-b078dbb70025 req-621e8628-4d13-4850-8a24-0037bf78fd54 tempest-VolumesSnapshotsTestJSON-177043574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.48f31915-355e-431b-afa1-5a37d9e8fed1" returned: 0 in 0.624s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:04 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [req-26eaac03-cb2c-46ed-984c-b078dbb70025 req-621e8628-4d13-4850-8a24-0037bf78fd54 tempest-VolumesSnapshotsTestJSON-177043574 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.48f31915-355e-431b-afa1-5a37d9e8fed1 is being set with open permissions: ugo+rw Apr 27 10:08:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-26eaac03-cb2c-46ed-984c-b078dbb70025 req-621e8628-4d13-4850-8a24-0037bf78fd54 tempest-VolumesSnapshotsTestJSON-177043574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.48f31915-355e-431b-afa1-5a37d9e8fed1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:04 devstack sudo[85280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.48f31915-355e-431b-afa1-5a37d9e8fed1 Apr 27 10:08:04 devstack sudo[85280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:05 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5d5db54a-c228-4246-af4b-832cccbe6e07 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "cinder-0cc2f101-800a-4b50-b8d2-bae3d86f4708-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:05 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5d5db54a-c228-4246-af4b-832cccbe6e07 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-0cc2f101-800a-4b50-b8d2-bae3d86f4708-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:05 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5d5db54a-c228-4246-af4b-832cccbe6e07 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "cinder-quobyte-0cc2f101-800a-4b50-b8d2-bae3d86f4708" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:05 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5d5db54a-c228-4246-af4b-832cccbe6e07 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-0cc2f101-800a-4b50-b8d2-bae3d86f4708" acquired by "delete_volume" :: waited 0.035s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:05 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[397f937a-6973-405c-9b5d-588339e728b6]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5d5db54a-c228-4246-af4b-832cccbe6e07 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:05 devstack sudo[85280]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-26eaac03-cb2c-46ed-984c-b078dbb70025 req-621e8628-4d13-4850-8a24-0037bf78fd54 tempest-VolumesSnapshotsTestJSON-177043574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.48f31915-355e-431b-afa1-5a37d9e8fed1" returned: 0 in 0.659s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-26eaac03-cb2c-46ed-984c-b078dbb70025 req-621e8628-4d13-4850-8a24-0037bf78fd54 tempest-VolumesSnapshotsTestJSON-177043574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:05 devstack sudo[85291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 Apr 27 10:08:05 devstack sudo[85291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:05 devstack sudo[85295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.info Apr 27 10:08:05 devstack sudo[85295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:05 devstack sudo[85295]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-26eaac03-cb2c-46ed-984c-b078dbb70025 req-621e8628-4d13-4850-8a24-0037bf78fd54 tempest-VolumesSnapshotsTestJSON-177043574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.info" returned: 0 in 0.514s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:05 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [req-26eaac03-cb2c-46ed-984c-b078dbb70025 req-621e8628-4d13-4850-8a24-0037bf78fd54 tempest-VolumesSnapshotsTestJSON-177043574 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.info is being set with open permissions: ugo+rw Apr 27 10:08:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-26eaac03-cb2c-46ed-984c-b078dbb70025 req-621e8628-4d13-4850-8a24-0037bf78fd54 tempest-VolumesSnapshotsTestJSON-177043574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:06 devstack sudo[85308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.info Apr 27 10:08:06 devstack sudo[85308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:06 devstack sudo[85291]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5d5db54a-c228-4246-af4b-832cccbe6e07 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708" returned: 0 in 0.811s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5d5db54a-c228-4246-af4b-832cccbe6e07 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:06 devstack sudo[85324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708 Apr 27 10:08:06 devstack sudo[85324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:06 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-a8504eab-c75b-471c-96d7-58a5c07aab84 tempest-GroupSnapshotsV319Test-1709429969 None] Group tempest-GroupSnapshotsV319Test-Group-1573763887: creating Apr 27 10:08:06 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-a8504eab-c75b-471c-96d7-58a5c07aab84 tempest-GroupSnapshotsV319Test-1709429969 None] Group tempest-GroupSnapshotsV319Test-Group-1573763887: created successfully Apr 27 10:08:06 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-a8504eab-c75b-471c-96d7-58a5c07aab84 tempest-GroupSnapshotsV319Test-1709429969 None] Create group completed successfully. Apr 27 10:08:06 devstack sudo[85308]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-26eaac03-cb2c-46ed-984c-b078dbb70025 req-621e8628-4d13-4850-8a24-0037bf78fd54 tempest-VolumesSnapshotsTestJSON-177043574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.info" returned: 0 in 0.980s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-26eaac03-cb2c-46ed-984c-b078dbb70025 req-621e8628-4d13-4850-8a24-0037bf78fd54 tempest-VolumesSnapshotsTestJSON-177043574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.783s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:07 devstack cinder-volume[81350]: INFO cinder.volume.manager [req-26eaac03-cb2c-46ed-984c-b078dbb70025 req-621e8628-4d13-4850-8a24-0037bf78fd54 tempest-VolumesSnapshotsTestJSON-177043574 None] Create snapshot completed successfully Apr 27 10:08:07 devstack sudo[85324]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5d5db54a-c228-4246-af4b-832cccbe6e07 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0cc2f101-800a-4b50-b8d2-bae3d86f4708" returned: 0 in 0.888s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:07 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5d5db54a-c228-4246-af4b-832cccbe6e07 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-0cc2f101-800a-4b50-b8d2-bae3d86f4708" released by "delete_volume" :: held 1.821s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:07 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-5d5db54a-c228-4246-af4b-832cccbe6e07 tempest-VolumesSnapshotTestJSON-1648254463 None] Created reservations ['6b6ee596-b841-4876-9ef6-7843a3de04d1', '321e32d8-b68e-4220-b6ae-fa269d8233b5', '1a8c14af-3b9a-4fa1-8bce-74a23e3d2098', 'd7d05b64-b129-4365-bd14-7548c69afa0f'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:08:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5d5db54a-c228-4246-af4b-832cccbe6e07 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5d5db54a-c228-4246-af4b-832cccbe6e07 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:07 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5d5db54a-c228-4246-af4b-832cccbe6e07 tempest-VolumesSnapshotTestJSON-1648254463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:08:07 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5d5db54a-c228-4246-af4b-832cccbe6e07 tempest-VolumesSnapshotTestJSON-1648254463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:08:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5d5db54a-c228-4246-af4b-832cccbe6e07 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5d5db54a-c228-4246-af4b-832cccbe6e07 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:07 devstack sudo[85347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:08:07 devstack sudo[85347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:07 devstack sudo[85347]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5d5db54a-c228-4246-af4b-832cccbe6e07 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.668s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:07 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-5d5db54a-c228-4246-af4b-832cccbe6e07 tempest-VolumesSnapshotTestJSON-1648254463 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:08:07 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-5d5db54a-c228-4246-af4b-832cccbe6e07 tempest-VolumesSnapshotTestJSON-1648254463 None] Deleted volume successfully. Apr 27 10:08:07 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5d5db54a-c228-4246-af4b-832cccbe6e07 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-0cc2f101-800a-4b50-b8d2-bae3d86f4708-delete_volume" released by "delete_volume" :: held 2.739s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-f2b0f127-49ca-4b25-9f9f-50528b44855b req-db5c1474-3688-4bf2-b2ca-f40f55566031 tempest-VolumesSnapshotsTestJSON-177043574 None] Acquiring lock "cinder-48f31915-355e-431b-afa1-5a37d9e8fed1-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-f2b0f127-49ca-4b25-9f9f-50528b44855b req-db5c1474-3688-4bf2-b2ca-f40f55566031 tempest-VolumesSnapshotsTestJSON-177043574 None] Lock "cinder-48f31915-355e-431b-afa1-5a37d9e8fed1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-f2b0f127-49ca-4b25-9f9f-50528b44855b req-db5c1474-3688-4bf2-b2ca-f40f55566031 tempest-VolumesSnapshotsTestJSON-177043574 None] Acquiring lock "cinder-quobyte-a05088c3-8c85-4b79-8b04-b1f91cb678b1" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Flow 'volume_create_manager' (37a06d70-e67a-4eb3-ac25-7406f884d24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d5ffc1-f4ff-4fe5-90d3-ad396bdfc795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d5ffc1-f4ff-4fe5-90d3-ad396bdfc795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2120114558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d44a31f5-2230-4a44-84bb-2127f3e228d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a66e2922c547b68c14b3aca35d55bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:08:08Z,use_quota=True,user_id='9b4e8350433047bab63c9604cff72955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcec3f16-d39c-43e3-89be-d0b101af34f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcec3f16-d39c-43e3-89be-d0b101af34f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a028c06b-ec09-4b94-908d-85cbd065884b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a028c06b-ec09-4b94-908d-85cbd065884b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd44a31f5-2230-4a44-84bb-2127f3e228d2', 'volume_name': 'volume-d44a31f5-2230-4a44-84bb-2127f3e228d2', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05968842-a20d-4240-85b2-8a76b798fe4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05968842-a20d-4240-85b2-8a76b798fe4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06628810-ae48-4dd7-9438-ddd3c11cfcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:08 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Volume d44a31f5-2230-4a44-84bb-2127f3e228d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d44a31f5-2230-4a44-84bb-2127f3e228d2', 'volume_size': 1} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2120114558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d44a31f5-2230-4a44-84bb-2127f3e228d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a66e2922c547b68c14b3aca35d55bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:08:08Z,use_quota=True,user_id='9b4e8350433047bab63c9604cff72955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Creating volume d44a31f5-2230-4a44-84bb-2127f3e228d2 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:08:08 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-f2b0f127-49ca-4b25-9f9f-50528b44855b req-db5c1474-3688-4bf2-b2ca-f40f55566031 tempest-VolumesSnapshotsTestJSON-177043574 None] Lock "cinder-quobyte-a05088c3-8c85-4b79-8b04-b1f91cb678b1" acquired by "delete_snapshot" :: waited 0.137s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:08 devstack sudo[85353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 1073741824 Apr 27 10:08:08 devstack sudo[85353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-f2b0f127-49ca-4b25-9f9f-50528b44855b req-db5c1474-3688-4bf2-b2ca-f40f55566031 tempest-VolumesSnapshotsTestJSON-177043574 None] Acquiring lock "cinder-quobyte-48f31915-355e-431b-afa1-5a37d9e8fed1" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Flow 'volume_create_manager' (6e52be49-e0bf-428e-89fb-f956baad4b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8fc643b-64cb-4ebf-b81e-2fe4d98b2bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-f2b0f127-49ca-4b25-9f9f-50528b44855b req-db5c1474-3688-4bf2-b2ca-f40f55566031 tempest-VolumesSnapshotsTestJSON-177043574 None] Lock "cinder-quobyte-48f31915-355e-431b-afa1-5a37d9e8fed1" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [req-f2b0f127-49ca-4b25-9f9f-50528b44855b req-db5c1474-3688-4bf2-b2ca-f40f55566031 tempest-VolumesSnapshotsTestJSON-177043574 None] Deleting offline snapshot 48f31915-355e-431b-afa1-5a37d9e8fed1 of volume a05088c3-8c85-4b79-8b04-b1f91cb678b1 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [req-f2b0f127-49ca-4b25-9f9f-50528b44855b req-db5c1474-3688-4bf2-b2ca-f40f55566031 tempest-VolumesSnapshotsTestJSON-177043574 None] snapshot_file for this snap is: volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.48f31915-355e-431b-afa1-5a37d9e8fed1 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bb8234-9712-49fa-83ba-ee6bef14bfb6]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-f2b0f127-49ca-4b25-9f9f-50528b44855b req-db5c1474-3688-4bf2-b2ca-f40f55566031 tempest-VolumesSnapshotsTestJSON-177043574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.48f31915-355e-431b-afa1-5a37d9e8fed1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8fc643b-64cb-4ebf-b81e-2fe4d98b2bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1749538032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97f5931d-7b2c-4add-ad61-dd5417d0089b,host='devstack@QuobyteHD#QuobyteHD',id=b38cff19-9477-47dc-9077-d1fb9715d7e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c41ce0b241b4a739affa46f1c0cdfb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:08:08Z,use_quota=True,user_id='058e95e49cd74ed08d721a2b885ac4cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f792edc1-ff41-4b23-92d8-3f6005293d44),volume_type_id=f792edc1-ff41-4b23-92d8-3f6005293d44)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a76d8e0-de41-4330-80f7-d5de80159cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a76d8e0-de41-4330-80f7-d5de80159cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47784894-519b-4a37-af85-261d217d0192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47784894-519b-4a37-af85-261d217d0192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b38cff19-9477-47dc-9077-d1fb9715d7e8', 'volume_name': 'volume-b38cff19-9477-47dc-9077-d1fb9715d7e8', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8425449-5dbb-4266-9cab-7b01394432f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8425449-5dbb-4266-9cab-7b01394432f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db0bd3b8-2a9f-42a9-97ca-ac4d6c93fbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:08 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Volume b38cff19-9477-47dc-9077-d1fb9715d7e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b38cff19-9477-47dc-9077-d1fb9715d7e8', 'volume_size': 1} Apr 27 10:08:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:08 devstack sudo[85355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.48f31915-355e-431b-afa1-5a37d9e8fed1 Apr 27 10:08:08 devstack sudo[85355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:09 devstack sudo[85353]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 1073741824" returned: 0 in 0.729s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:09 devstack sudo[85355]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-f2b0f127-49ca-4b25-9f9f-50528b44855b req-db5c1474-3688-4bf2-b2ca-f40f55566031 tempest-VolumesSnapshotsTestJSON-177043574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.48f31915-355e-431b-afa1-5a37d9e8fed1" returned: 0 in 0.632s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [req-f2b0f127-49ca-4b25-9f9f-50528b44855b req-db5c1474-3688-4bf2-b2ca-f40f55566031 tempest-VolumesSnapshotsTestJSON-177043574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da349d0-e9ef-4e61-9408-da3db9671938]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-f2b0f127-49ca-4b25-9f9f-50528b44855b req-db5c1474-3688-4bf2-b2ca-f40f55566031 tempest-VolumesSnapshotsTestJSON-177043574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:09 devstack sudo[85365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 Apr 27 10:08:09 devstack sudo[85365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:09 devstack sudo[85364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1 Apr 27 10:08:09 devstack sudo[85364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:09 devstack sudo[85365]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2" returned: 0 in 0.615s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.256s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=97f5931d-7b2c-4add-ad61-dd5417d0089b,created_at=2026-04-27T08:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1749538032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97f5931d-7b2c-4add-ad61-dd5417d0089b,host='devstack@QuobyteHD#QuobyteHD',id=b38cff19-9477-47dc-9077-d1fb9715d7e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c41ce0b241b4a739affa46f1c0cdfb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:08:08Z,use_quota=True,user_id='058e95e49cd74ed08d721a2b885ac4cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f792edc1-ff41-4b23-92d8-3f6005293d44),volume_type_id=f792edc1-ff41-4b23-92d8-3f6005293d44)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Creating volume b38cff19-9477-47dc-9077-d1fb9715d7e8 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:08:09 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:09 devstack sudo[85364]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-f2b0f127-49ca-4b25-9f9f-50528b44855b req-db5c1474-3688-4bf2-b2ca-f40f55566031 tempest-VolumesSnapshotsTestJSON-177043574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1" returned: 0 in 0.660s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-f2b0f127-49ca-4b25-9f9f-50528b44855b req-db5c1474-3688-4bf2-b2ca-f40f55566031 tempest-VolumesSnapshotsTestJSON-177043574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.48f31915-355e-431b-afa1-5a37d9e8fed1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:09 devstack sudo[85372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8 1073741824 Apr 27 10:08:09 devstack sudo[85372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06628810-ae48-4dd7-9438-ddd3c11cfcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d44a31f5-2230-4a44-84bb-2127f3e228d2', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428bae9e-d7de-4e2a-a6db-556e76ad9887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:09 devstack sudo[85373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.48f31915-355e-431b-afa1-5a37d9e8fed1 Apr 27 10:08:09 devstack sudo[85373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:09 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Volume volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 (d44a31f5-2230-4a44-84bb-2127f3e228d2): created successfully Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428bae9e-d7de-4e2a-a6db-556e76ad9887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:09 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Flow 'volume_create_manager' (37a06d70-e67a-4eb3-ac25-7406f884d24d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:08:09 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-c67bcce0-fdb2-4dbc-aa01-573f1b2b33d6 tempest-VolumesSnapshotTestJSON-1648254463 None] Created volume successfully. Apr 27 10:08:10 devstack sudo[85373]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-f2b0f127-49ca-4b25-9f9f-50528b44855b req-db5c1474-3688-4bf2-b2ca-f40f55566031 tempest-VolumesSnapshotsTestJSON-177043574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.48f31915-355e-431b-afa1-5a37d9e8fed1" returned: 0 in 0.637s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-f2b0f127-49ca-4b25-9f9f-50528b44855b req-db5c1474-3688-4bf2-b2ca-f40f55566031 tempest-VolumesSnapshotsTestJSON-177043574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.48f31915-355e-431b-afa1-5a37d9e8fed1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:10 devstack sudo[85383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.48f31915-355e-431b-afa1-5a37d9e8fed1 Apr 27 10:08:10 devstack sudo[85383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:10 devstack sudo[85372]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8 1073741824" returned: 0 in 0.722s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:10 devstack sudo[85385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8 Apr 27 10:08:10 devstack sudo[85385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1b7b4051-7533-430a-90be-8b1824793575 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:10 devstack sudo[85383]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-f2b0f127-49ca-4b25-9f9f-50528b44855b req-db5c1474-3688-4bf2-b2ca-f40f55566031 tempest-VolumesSnapshotsTestJSON-177043574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1.48f31915-355e-431b-afa1-5a37d9e8fed1" returned: 0 in 0.460s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-f2b0f127-49ca-4b25-9f9f-50528b44855b req-db5c1474-3688-4bf2-b2ca-f40f55566031 tempest-VolumesSnapshotsTestJSON-177043574 None] Lock "cinder-quobyte-48f31915-355e-431b-afa1-5a37d9e8fed1" released by "_delete_snapshot" :: held 2.512s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-f2b0f127-49ca-4b25-9f9f-50528b44855b req-db5c1474-3688-4bf2-b2ca-f40f55566031 tempest-VolumesSnapshotsTestJSON-177043574 None] Lock "cinder-quobyte-a05088c3-8c85-4b79-8b04-b1f91cb678b1" released by "delete_snapshot" :: held 2.568s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG cinder.quota [req-f2b0f127-49ca-4b25-9f9f-50528b44855b req-db5c1474-3688-4bf2-b2ca-f40f55566031 tempest-VolumesSnapshotsTestJSON-177043574 None] Created reservations ['e0426e7b-2b50-4e05-8783-2e1f944cd853', '761f8b83-0be5-4fc9-9716-c867d15213bc', '4d031b52-aa76-4705-9624-4eb9ef41d5dc', '641f1326-d418-4c4b-a479-6906ee8e77e8'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:08:11 devstack sudo[85385]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8" returned: 0 in 0.511s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1b7b4051-7533-430a-90be-8b1824793575 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.320s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db0bd3b8-2a9f-42a9-97ca-ac4d6c93fbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b38cff19-9477-47dc-9077-d1fb9715d7e8', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8135239b-de97-49e5-846c-394ef7295fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:11 devstack cinder-volume[81350]: INFO cinder.volume.manager [req-f2b0f127-49ca-4b25-9f9f-50528b44855b req-db5c1474-3688-4bf2-b2ca-f40f55566031 tempest-VolumesSnapshotsTestJSON-177043574 None] Delete snapshot completed successfully. Apr 27 10:08:11 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Volume volume-b38cff19-9477-47dc-9077-d1fb9715d7e8 (b38cff19-9477-47dc-9077-d1fb9715d7e8): created successfully Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8135239b-de97-49e5-846c-394ef7295fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Flow 'volume_create_manager' (6e52be49-e0bf-428e-89fb-f956baad4b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-f2b0f127-49ca-4b25-9f9f-50528b44855b req-db5c1474-3688-4bf2-b2ca-f40f55566031 tempest-VolumesSnapshotsTestJSON-177043574 None] Lock "cinder-48f31915-355e-431b-afa1-5a37d9e8fed1-delete_snapshot" released by "delete_snapshot" :: held 2.870s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:11 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-bce14c3c-ef52-4200-b0af-b0f2e23c581c tempest-GroupSnapshotsV319Test-1709429969 None] Created volume successfully. Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-1b7b4051-7533-430a-90be-8b1824793575 tempest-VolumesSnapshotTestJSON-1648254463 None] Creating offline snapshot 09463d88-34b8-4767-9da3-825074ecb6b6 of volume d44a31f5-2230-4a44-84bb-2127f3e228d2 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8da2582-95d3-4afb-98f7-ec1d3e9ea179]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1b7b4051-7533-430a-90be-8b1824793575 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:11 devstack sudo[85390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 Apr 27 10:08:11 devstack sudo[85390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-2bb20d3f-4d9d-4376-a242-eefca1d183e2 req-17ea1410-b408-4ace-bfb6-ddee704597c4 tempest-VolumesSnapshotsTestJSON-177043574 None] Acquiring lock "cinder-a05088c3-8c85-4b79-8b04-b1f91cb678b1-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-2bb20d3f-4d9d-4376-a242-eefca1d183e2 req-17ea1410-b408-4ace-bfb6-ddee704597c4 tempest-VolumesSnapshotsTestJSON-177043574 None] Lock "cinder-a05088c3-8c85-4b79-8b04-b1f91cb678b1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-2bb20d3f-4d9d-4376-a242-eefca1d183e2 req-17ea1410-b408-4ace-bfb6-ddee704597c4 tempest-VolumesSnapshotsTestJSON-177043574 None] Acquiring lock "cinder-quobyte-a05088c3-8c85-4b79-8b04-b1f91cb678b1" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-2bb20d3f-4d9d-4376-a242-eefca1d183e2 req-17ea1410-b408-4ace-bfb6-ddee704597c4 tempest-VolumesSnapshotsTestJSON-177043574 None] Lock "cinder-quobyte-a05088c3-8c85-4b79-8b04-b1f91cb678b1" acquired by "delete_volume" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4fb2e2-93da-4337-91d8-499beb5e77ba]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-2bb20d3f-4d9d-4376-a242-eefca1d183e2 req-17ea1410-b408-4ace-bfb6-ddee704597c4 tempest-VolumesSnapshotsTestJSON-177043574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:11 devstack sudo[85395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1 Apr 27 10:08:11 devstack sudo[85395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:11 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-ccb9ba91-435d-4812-b594-7bf55ee96d85 tempest-GroupSnapshotsV319Test-1709429969 None] GroupSnapshot 27a02d5a-c987-46ee-a774-ff4421de52e9: creating. Apr 27 10:08:11 devstack sudo[85390]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:UPDATE=100,cinder:SELECT=93,cinder:INSERT=20,cinder:DELETE=12 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1b7b4051-7533-430a-90be-8b1824793575 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2" returned: 0 in 0.733s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1b7b4051-7533-430a-90be-8b1824793575 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.09463d88-34b8-4767-9da3-825074ecb6b6 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ccb9ba91-435d-4812-b594-7bf55ee96d85 tempest-GroupSnapshotsV319Test-1709429969 None] Group snapshot 27a02d5a-c987-46ee-a774-ff4421de52e9: creating. {{(pid=81350) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 27 10:08:12 devstack sudo[85397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.09463d88-34b8-4767-9da3-825074ecb6b6 1G Apr 27 10:08:12 devstack sudo[85397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ccb9ba91-435d-4812-b594-7bf55ee96d85 tempest-GroupSnapshotsV319Test-1709429969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:12 devstack sudo[85395]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-2bb20d3f-4d9d-4376-a242-eefca1d183e2 req-17ea1410-b408-4ace-bfb6-ddee704597c4 tempest-VolumesSnapshotsTestJSON-177043574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1" returned: 0 in 0.584s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-2bb20d3f-4d9d-4376-a242-eefca1d183e2 req-17ea1410-b408-4ace-bfb6-ddee704597c4 tempest-VolumesSnapshotsTestJSON-177043574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:12 devstack sudo[85405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1 Apr 27 10:08:12 devstack sudo[85405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:12 devstack sudo[85397]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1b7b4051-7533-430a-90be-8b1824793575 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.09463d88-34b8-4767-9da3-825074ecb6b6 1G" returned: 0 in 0.592s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1b7b4051-7533-430a-90be-8b1824793575 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.09463d88-34b8-4767-9da3-825074ecb6b6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:12 devstack sudo[85407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.09463d88-34b8-4767-9da3-825074ecb6b6 Apr 27 10:08:12 devstack sudo[85407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:12 devstack sudo[85405]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-2bb20d3f-4d9d-4376-a242-eefca1d183e2 req-17ea1410-b408-4ace-bfb6-ddee704597c4 tempest-VolumesSnapshotsTestJSON-177043574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a05088c3-8c85-4b79-8b04-b1f91cb678b1" returned: 0 in 0.504s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:12 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-2bb20d3f-4d9d-4376-a242-eefca1d183e2 req-17ea1410-b408-4ace-bfb6-ddee704597c4 tempest-VolumesSnapshotsTestJSON-177043574 None] Lock "cinder-quobyte-a05088c3-8c85-4b79-8b04-b1f91cb678b1" released by "delete_volume" :: held 1.159s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:12 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:SELECT=96,cinder:UPDATE=104,cinder:DELETE=7,cinder:INSERT=28 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:08:13 devstack cinder-volume[81350]: DEBUG cinder.quota [req-2bb20d3f-4d9d-4376-a242-eefca1d183e2 req-17ea1410-b408-4ace-bfb6-ddee704597c4 tempest-VolumesSnapshotsTestJSON-177043574 None] Created reservations ['2c422ff5-e336-4b83-b034-d00af9a8c14c', 'c4a052ae-3333-415e-9d05-b91b08df8250', '55482a79-3d53-45c3-83cb-aa9f9af0a32d', '93d57aea-7957-43ff-b17e-a14e95a4494c'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:08:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-2bb20d3f-4d9d-4376-a242-eefca1d183e2 req-17ea1410-b408-4ace-bfb6-ddee704597c4 tempest-VolumesSnapshotsTestJSON-177043574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-2bb20d3f-4d9d-4376-a242-eefca1d183e2 req-17ea1410-b408-4ace-bfb6-ddee704597c4 tempest-VolumesSnapshotsTestJSON-177043574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:13 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-2bb20d3f-4d9d-4376-a242-eefca1d183e2 req-17ea1410-b408-4ace-bfb6-ddee704597c4 tempest-VolumesSnapshotsTestJSON-177043574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:08:13 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-2bb20d3f-4d9d-4376-a242-eefca1d183e2 req-17ea1410-b408-4ace-bfb6-ddee704597c4 tempest-VolumesSnapshotsTestJSON-177043574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:08:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-2bb20d3f-4d9d-4376-a242-eefca1d183e2 req-17ea1410-b408-4ace-bfb6-ddee704597c4 tempest-VolumesSnapshotsTestJSON-177043574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-2bb20d3f-4d9d-4376-a242-eefca1d183e2 req-17ea1410-b408-4ace-bfb6-ddee704597c4 tempest-VolumesSnapshotsTestJSON-177043574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:13 devstack sudo[85413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:08:13 devstack sudo[85413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:13 devstack sudo[85407]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1b7b4051-7533-430a-90be-8b1824793575 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.09463d88-34b8-4767-9da3-825074ecb6b6" returned: 0 in 0.591s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:13 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-1b7b4051-7533-430a-90be-8b1824793575 tempest-VolumesSnapshotTestJSON-1648254463 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.09463d88-34b8-4767-9da3-825074ecb6b6 is being set with open permissions: ugo+rw Apr 27 10:08:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1b7b4051-7533-430a-90be-8b1824793575 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.09463d88-34b8-4767-9da3-825074ecb6b6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:13 devstack sudo[85415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.09463d88-34b8-4767-9da3-825074ecb6b6 Apr 27 10:08:13 devstack sudo[85415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:13 devstack sudo[85413]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-2bb20d3f-4d9d-4376-a242-eefca1d183e2 req-17ea1410-b408-4ace-bfb6-ddee704597c4 tempest-VolumesSnapshotsTestJSON-177043574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.439s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:13 devstack cinder-volume[81350]: DEBUG cinder.manager [req-2bb20d3f-4d9d-4376-a242-eefca1d183e2 req-17ea1410-b408-4ace-bfb6-ddee704597c4 tempest-VolumesSnapshotsTestJSON-177043574 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:08:13 devstack cinder-volume[81350]: INFO cinder.volume.manager [req-2bb20d3f-4d9d-4376-a242-eefca1d183e2 req-17ea1410-b408-4ace-bfb6-ddee704597c4 tempest-VolumesSnapshotsTestJSON-177043574 None] Deleted volume successfully. Apr 27 10:08:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-2bb20d3f-4d9d-4376-a242-eefca1d183e2 req-17ea1410-b408-4ace-bfb6-ddee704597c4 tempest-VolumesSnapshotsTestJSON-177043574 None] Lock "cinder-a05088c3-8c85-4b79-8b04-b1f91cb678b1-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:13 devstack sudo[85415]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1b7b4051-7533-430a-90be-8b1824793575 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.09463d88-34b8-4767-9da3-825074ecb6b6" returned: 0 in 0.450s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1b7b4051-7533-430a-90be-8b1824793575 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:13 devstack sudo[85419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.info Apr 27 10:08:13 devstack sudo[85419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:14 devstack sudo[85419]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1b7b4051-7533-430a-90be-8b1824793575 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.info" returned: 0 in 0.679s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:14 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-1b7b4051-7533-430a-90be-8b1824793575 tempest-VolumesSnapshotTestJSON-1648254463 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.info is being set with open permissions: ugo+rw Apr 27 10:08:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1b7b4051-7533-430a-90be-8b1824793575 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:14 devstack sudo[85447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.info Apr 27 10:08:14 devstack sudo[85447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:14 devstack sudo[85447]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1b7b4051-7533-430a-90be-8b1824793575 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.info" returned: 0 in 0.525s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1b7b4051-7533-430a-90be-8b1824793575 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.708s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ccb9ba91-435d-4812-b594-7bf55ee96d85 tempest-GroupSnapshotsV319Test-1709429969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.866s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-ccb9ba91-435d-4812-b594-7bf55ee96d85 tempest-GroupSnapshotsV319Test-1709429969 None] Creating offline snapshot 5e09c5ac-19f4-4855-bba6-62875e740d01 of volume b38cff19-9477-47dc-9077-d1fb9715d7e8 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:08:14 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-1b7b4051-7533-430a-90be-8b1824793575 tempest-VolumesSnapshotTestJSON-1648254463 None] Create snapshot completed successfully Apr 27 10:08:14 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0fb071-68b7-4ab0-9823-381390bfe425]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccb9ba91-435d-4812-b594-7bf55ee96d85 tempest-GroupSnapshotsV319Test-1709429969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:15 devstack sudo[85458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8 Apr 27 10:08:15 devstack sudo[85458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:15 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:08:15 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Flow 'volume_create_manager' (0ba45844-da60-4340-a851-7683b2913fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:08:15 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5cf2feb-38bc-4c08-8435-096d6c127249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:15 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5cf2feb-38bc-4c08-8435-096d6c127249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-787050274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dd30554-d4e4-4cb8-8a91-c7aaba4ed861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a66e2922c547b68c14b3aca35d55bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=09463d88-34b8-4767-9da3-825074ecb6b6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:08:15Z,use_quota=True,user_id='9b4e8350433047bab63c9604cff72955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:15 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecbd83e6-6c7f-40e2-b799-0d9a1e836990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:15 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecbd83e6-6c7f-40e2-b799-0d9a1e836990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:15 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db260992-0509-436e-a757-7955c7f4b917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:15 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db260992-0509-436e-a757-7955c7f4b917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5dd30554-d4e4-4cb8-8a91-c7aaba4ed861', 'volume_name': 'volume-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861', 'volume_size': 1, 'snapshot_id': '09463d88-34b8-4767-9da3-825074ecb6b6'}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:15 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8978a0b-8bf5-4c70-987f-f0f30e0fc91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:15 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8978a0b-8bf5-4c70-987f-f0f30e0fc91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:15 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (305e25e9-2fbc-4b82-960e-63b5fe6a54db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:15 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Volume 5dd30554-d4e4-4cb8-8a91-c7aaba4ed861: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861', 'volume_size': 1, 'snapshot_id': '09463d88-34b8-4767-9da3-825074ecb6b6'} Apr 27 10:08:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:15 devstack sudo[85458]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccb9ba91-435d-4812-b594-7bf55ee96d85 tempest-GroupSnapshotsV319Test-1709429969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8" returned: 0 in 0.774s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccb9ba91-435d-4812-b594-7bf55ee96d85 tempest-GroupSnapshotsV319Test-1709429969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.5e09c5ac-19f4-4855-bba6-62875e740d01 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:15 devstack sudo[85463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.5e09c5ac-19f4-4855-bba6-62875e740d01 1G Apr 27 10:08:15 devstack sudo[85463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:16 devstack sudo[85463]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccb9ba91-435d-4812-b594-7bf55ee96d85 tempest-GroupSnapshotsV319Test-1709429969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.5e09c5ac-19f4-4855-bba6-62875e740d01 1G" returned: 0 in 0.762s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccb9ba91-435d-4812-b594-7bf55ee96d85 tempest-GroupSnapshotsV319Test-1709429969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b38cff19-9477-47dc-9077-d1fb9715d7e8 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.5e09c5ac-19f4-4855-bba6-62875e740d01 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:16 devstack sudo[85481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b38cff19-9477-47dc-9077-d1fb9715d7e8 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.5e09c5ac-19f4-4855-bba6-62875e740d01 Apr 27 10:08:16 devstack sudo[85481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:16 devstack cinder-volume[81350]: DEBUG oslo_service.periodic_task [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81350) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 10:08:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:08:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:08:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:16 devstack sudo[85488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:08:16 devstack sudo[85488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:17 devstack sudo[85481]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccb9ba91-435d-4812-b594-7bf55ee96d85 tempest-GroupSnapshotsV319Test-1709429969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b38cff19-9477-47dc-9077-d1fb9715d7e8 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.5e09c5ac-19f4-4855-bba6-62875e740d01" returned: 0 in 0.599s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:17 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-ccb9ba91-435d-4812-b594-7bf55ee96d85 tempest-GroupSnapshotsV319Test-1709429969 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.5e09c5ac-19f4-4855-bba6-62875e740d01 is being set with open permissions: ugo+rw: NotImplementedError Apr 27 10:08:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccb9ba91-435d-4812-b594-7bf55ee96d85 tempest-GroupSnapshotsV319Test-1709429969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.5e09c5ac-19f4-4855-bba6-62875e740d01 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:17 devstack sudo[85494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.5e09c5ac-19f4-4855-bba6-62875e740d01 Apr 27 10:08:17 devstack sudo[85494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:17 devstack sudo[85488]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.526s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:17 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:08:17 devstack sudo[85494]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccb9ba91-435d-4812-b594-7bf55ee96d85 tempest-GroupSnapshotsV319Test-1709429969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.5e09c5ac-19f4-4855-bba6-62875e740d01" returned: 0 in 0.495s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccb9ba91-435d-4812-b594-7bf55ee96d85 tempest-GroupSnapshotsV319Test-1709429969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:17 devstack sudo[85497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.info Apr 27 10:08:17 devstack sudo[85497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:17 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:08:17 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Flow 'volume_create_manager' (b1357fe3-7d79-435d-b3d5-c1da6290b898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:08:17 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac00af7-0a73-47fd-b881-a554728a3286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:17 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac00af7-0a73-47fd-b881-a554728a3286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-840992025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d141c6-b433-4ccd-ae75-fc81e8ed2e88,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1d009419ab1468fa1e45e954f9d3906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:08:18Z,use_quota=True,user_id='16b1b751eb6340b9a26c33d803d94f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:17 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9c1bcf-dcd5-421f-acbe-045fb4f1a099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:17 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9c1bcf-dcd5-421f-acbe-045fb4f1a099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:17 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1395176d-9e6e-4e5b-94d6-d66e4d773d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:17 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1395176d-9e6e-4e5b-94d6-d66e4d773d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38d141c6-b433-4ccd-ae75-fc81e8ed2e88', 'volume_name': 'volume-38d141c6-b433-4ccd-ae75-fc81e8ed2e88', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:17 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded9e5ef-dbe3-4f1c-a910-f37e1d0ae4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:17 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded9e5ef-dbe3-4f1c-a910-f37e1d0ae4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:17 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600ee62e-0e1e-4d22-b1c5-a85e9b491939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:17 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Volume 38d141c6-b433-4ccd-ae75-fc81e8ed2e88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38d141c6-b433-4ccd-ae75-fc81e8ed2e88', 'volume_size': 1} Apr 27 10:08:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:18 devstack sudo[85497]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccb9ba91-435d-4812-b594-7bf55ee96d85 tempest-GroupSnapshotsV319Test-1709429969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.info" returned: 0 in 0.511s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:18 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-ccb9ba91-435d-4812-b594-7bf55ee96d85 tempest-GroupSnapshotsV319Test-1709429969 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.info is being set with open permissions: ugo+rw: NotImplementedError Apr 27 10:08:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccb9ba91-435d-4812-b594-7bf55ee96d85 tempest-GroupSnapshotsV319Test-1709429969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:18 devstack sudo[85500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.info Apr 27 10:08:18 devstack sudo[85500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:18 devstack sudo[85500]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccb9ba91-435d-4812-b594-7bf55ee96d85 tempest-GroupSnapshotsV319Test-1709429969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.info" returned: 0 in 0.433s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ccb9ba91-435d-4812-b594-7bf55ee96d85 tempest-GroupSnapshotsV319Test-1709429969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.710s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.933s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:18 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "cinder-quobyte-09463d88-34b8-4767-9da3-825074ecb6b6-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861" by "_create_volume_from_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:18 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-09463d88-34b8-4767-9da3-825074ecb6b6-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:18 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Creating volume 5dd30554-d4e4-4cb8-8a91-c7aaba4ed861 from snapshot 09463d88-34b8-4767-9da3-825074ecb6b6 {{(pid=81350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 27 10:08:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:18 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:08:18 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:08:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:18 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:08:18 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "cinder-quobyte-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861" by "_copy_volume_from_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:18 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:18 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] snapshot: 09463d88-34b8-4767-9da3-825074ecb6b6, volume: 5dd30554-d4e4-4cb8-8a91-c7aaba4ed861, {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 27 10:08:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:18 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:08:18 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:08:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:18 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9cbaa8-da0b-4c86-963f-c74837cd4b5f]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.09463d88-34b8-4767-9da3-825074ecb6b6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:18 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-ccb9ba91-435d-4812-b594-7bf55ee96d85 tempest-GroupSnapshotsV319Test-1709429969 None] group_snapshot 27a02d5a-c987-46ee-a774-ff4421de52e9: created successfully Apr 27 10:08:18 devstack sudo[85503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.09463d88-34b8-4767-9da3-825074ecb6b6 Apr 27 10:08:18 devstack sudo[85503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:19 devstack sudo[85503]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.09463d88-34b8-4767-9da3-825074ecb6b6" returned: 0 in 0.601s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:19 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d44a31f5-2230-4a44-84bb-2127f3e228d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:08:19 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 27 10:08:19 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Creating direct copy from snapshot {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 27 10:08:19 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1200c614-56d8-4cb0-a70c-b95bcf03891c]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:19 devstack sudo[85510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 Apr 27 10:08:19 devstack sudo[85510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:19 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-2dc88336-a6bd-4f9b-bf79-d29fd86a9ee2 tempest-GroupSnapshotsV319Test-1709429969 None] group_snapshot 27a02d5a-c987-46ee-a774-ff4421de52e9: deleting Apr 27 10:08:19 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2dc88336-a6bd-4f9b-bf79-d29fd86a9ee2 tempest-GroupSnapshotsV319Test-1709429969 None] group_snapshot 27a02d5a-c987-46ee-a774-ff4421de52e9: deleting {{(pid=81350) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 27 10:08:19 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-2dc88336-a6bd-4f9b-bf79-d29fd86a9ee2 tempest-GroupSnapshotsV319Test-1709429969 None] Acquiring lock "cinder-quobyte-b38cff19-9477-47dc-9077-d1fb9715d7e8" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:19 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-2dc88336-a6bd-4f9b-bf79-d29fd86a9ee2 tempest-GroupSnapshotsV319Test-1709429969 None] Lock "cinder-quobyte-b38cff19-9477-47dc-9077-d1fb9715d7e8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:19 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-2dc88336-a6bd-4f9b-bf79-d29fd86a9ee2 tempest-GroupSnapshotsV319Test-1709429969 None] Acquiring lock "cinder-quobyte-5e09c5ac-19f4-4855-bba6-62875e740d01" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:19 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-2dc88336-a6bd-4f9b-bf79-d29fd86a9ee2 tempest-GroupSnapshotsV319Test-1709429969 None] Lock "cinder-quobyte-5e09c5ac-19f4-4855-bba6-62875e740d01" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:19 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-2dc88336-a6bd-4f9b-bf79-d29fd86a9ee2 tempest-GroupSnapshotsV319Test-1709429969 None] Deleting offline snapshot 5e09c5ac-19f4-4855-bba6-62875e740d01 of volume b38cff19-9477-47dc-9077-d1fb9715d7e8 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:08:19 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-2dc88336-a6bd-4f9b-bf79-d29fd86a9ee2 tempest-GroupSnapshotsV319Test-1709429969 None] snapshot_file for this snap is: volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.5e09c5ac-19f4-4855-bba6-62875e740d01 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:08:19 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a51854-b489-485e-9922-f842d28d571a]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2dc88336-a6bd-4f9b-bf79-d29fd86a9ee2 tempest-GroupSnapshotsV319Test-1709429969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.5e09c5ac-19f4-4855-bba6-62875e740d01 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:19 devstack sudo[85512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.5e09c5ac-19f4-4855-bba6-62875e740d01 Apr 27 10:08:19 devstack sudo[85512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:19 devstack sudo[85510]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2" returned: 0 in 0.599s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:19 devstack cinder-volume[81350]: DEBUG cinder.utils [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Path /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861 not found in is_blk_device check {{(pid=81350) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 27 10:08:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:19 devstack sudo[85517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861 Apr 27 10:08:19 devstack sudo[85517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:20 devstack sudo[85512]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2dc88336-a6bd-4f9b-bf79-d29fd86a9ee2 tempest-GroupSnapshotsV319Test-1709429969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.5e09c5ac-19f4-4855-bba6-62875e740d01" returned: 0 in 0.536s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:20 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-2dc88336-a6bd-4f9b-bf79-d29fd86a9ee2 tempest-GroupSnapshotsV319Test-1709429969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b38cff19-9477-47dc-9077-d1fb9715d7e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:08:20 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4139c9e-8a79-401d-9b90-4a12c322ce1f]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2dc88336-a6bd-4f9b-bf79-d29fd86a9ee2 tempest-GroupSnapshotsV319Test-1709429969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:20 devstack sudo[85525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8 Apr 27 10:08:20 devstack sudo[85525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:21 devstack sudo[85525]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2dc88336-a6bd-4f9b-bf79-d29fd86a9ee2 tempest-GroupSnapshotsV319Test-1709429969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8" returned: 0 in 1.249s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2dc88336-a6bd-4f9b-bf79-d29fd86a9ee2 tempest-GroupSnapshotsV319Test-1709429969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.5e09c5ac-19f4-4855-bba6-62875e740d01 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:21 devstack sudo[85548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.5e09c5ac-19f4-4855-bba6-62875e740d01 Apr 27 10:08:21 devstack sudo[85548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:23 devstack sudo[85548]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2dc88336-a6bd-4f9b-bf79-d29fd86a9ee2 tempest-GroupSnapshotsV319Test-1709429969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.5e09c5ac-19f4-4855-bba6-62875e740d01" returned: 0 in 1.959s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2dc88336-a6bd-4f9b-bf79-d29fd86a9ee2 tempest-GroupSnapshotsV319Test-1709429969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.5e09c5ac-19f4-4855-bba6-62875e740d01 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:23 devstack sudo[85613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.5e09c5ac-19f4-4855-bba6-62875e740d01 Apr 27 10:08:23 devstack sudo[85613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:25 devstack sudo[85613]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2dc88336-a6bd-4f9b-bf79-d29fd86a9ee2 tempest-GroupSnapshotsV319Test-1709429969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8.5e09c5ac-19f4-4855-bba6-62875e740d01" returned: 0 in 1.969s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:25 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-2dc88336-a6bd-4f9b-bf79-d29fd86a9ee2 tempest-GroupSnapshotsV319Test-1709429969 None] Lock "cinder-quobyte-5e09c5ac-19f4-4855-bba6-62875e740d01" released by "_delete_snapshot" :: held 5.893s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:25 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-2dc88336-a6bd-4f9b-bf79-d29fd86a9ee2 tempest-GroupSnapshotsV319Test-1709429969 None] Lock "cinder-quobyte-b38cff19-9477-47dc-9077-d1fb9715d7e8" released by "delete_snapshot" :: held 5.935s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:25 devstack cinder-volume[81350]: WARNING cinder.quota [None req-2dc88336-a6bd-4f9b-bf79-d29fd86a9ee2 tempest-GroupSnapshotsV319Test-1709429969 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1662566735 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1662566735, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:08:25 devstack cinder-volume[81350]: WARNING cinder.quota [None req-2dc88336-a6bd-4f9b-bf79-d29fd86a9ee2 tempest-GroupSnapshotsV319Test-1709429969 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1662566735 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1662566735, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:08:25 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-2dc88336-a6bd-4f9b-bf79-d29fd86a9ee2 tempest-GroupSnapshotsV319Test-1709429969 None] Created reservations ['dfeec814-1b02-43b3-a298-f87e78223331', '7396658f-b1cb-45bb-b942-852b6dd13afe', '88d7a1db-44d2-449b-93f7-eb05a8b7a701', '7089b9f4-d67f-457c-9aef-8d1e41873ef9'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:08:26 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-2dc88336-a6bd-4f9b-bf79-d29fd86a9ee2 tempest-GroupSnapshotsV319Test-1709429969 None] group_snapshot 27a02d5a-c987-46ee-a774-ff4421de52e9: deleted successfully Apr 27 10:08:27 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c9694bce-e450-4e38-97f6-a3ce241cd36f tempest-GroupSnapshotsV319Test-1709429969 None] Acquiring lock "cinder-quobyte-b38cff19-9477-47dc-9077-d1fb9715d7e8" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:27 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c9694bce-e450-4e38-97f6-a3ce241cd36f tempest-GroupSnapshotsV319Test-1709429969 None] Lock "cinder-quobyte-b38cff19-9477-47dc-9077-d1fb9715d7e8" acquired by "delete_volume" :: waited 0.032s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:27 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3644b66b-51b0-4504-a525-c1a9a8cf486f]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c9694bce-e450-4e38-97f6-a3ce241cd36f tempest-GroupSnapshotsV319Test-1709429969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:27 devstack sudo[85620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8 Apr 27 10:08:27 devstack sudo[85620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:27 devstack sudo[85517]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861" returned: 0 in 7.771s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:27 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9255e0-6098-4f66-8b90-b6e52e4b660f]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:27 devstack sudo[85622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 Apr 27 10:08:27 devstack sudo[85622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:28 devstack sudo[85620]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c9694bce-e450-4e38-97f6-a3ce241cd36f tempest-GroupSnapshotsV319Test-1709429969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8" returned: 0 in 0.683s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c9694bce-e450-4e38-97f6-a3ce241cd36f tempest-GroupSnapshotsV319Test-1709429969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:28 devstack sudo[85627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8 Apr 27 10:08:28 devstack sudo[85627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:28 devstack sudo[85622]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2" returned: 0 in 0.710s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:28 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Image conversion details: src /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2, size 1024.00 MB, duration 7.77 sec, destination /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861 {{(pid=81350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 10:08:28 devstack cinder-volume[81350]: INFO cinder.image.image_utils [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Converted 1024.00 MB image at 131.75 MB/s Apr 27 10:08:28 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861 is being set with open permissions: ugo+rw Apr 27 10:08:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:28 devstack sudo[85632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861 Apr 27 10:08:28 devstack sudo[85632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:28 devstack sudo[85627]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c9694bce-e450-4e38-97f6-a3ce241cd36f tempest-GroupSnapshotsV319Test-1709429969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b38cff19-9477-47dc-9077-d1fb9715d7e8" returned: 0 in 0.589s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:28 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c9694bce-e450-4e38-97f6-a3ce241cd36f tempest-GroupSnapshotsV319Test-1709429969 None] Lock "cinder-quobyte-b38cff19-9477-47dc-9077-d1fb9715d7e8" released by "delete_volume" :: held 1.446s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:28 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-c9694bce-e450-4e38-97f6-a3ce241cd36f tempest-GroupSnapshotsV319Test-1709429969 None] Created reservations ['8adf2c12-790b-470c-86bb-b556b1bfa500'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:08:28 devstack cinder-volume[81350]: WARNING cinder.quota [None req-c9694bce-e450-4e38-97f6-a3ce241cd36f tempest-GroupSnapshotsV319Test-1709429969 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1662566735 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1662566735, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:08:28 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-c9694bce-e450-4e38-97f6-a3ce241cd36f tempest-GroupSnapshotsV319Test-1709429969 None] Created reservations ['2d78d4f0-166d-4314-b3a4-f1c7402dbda7', '532d4ffd-b30c-48a2-a516-18d44b6e4ffc', '9e836d97-0a52-42de-a7c2-e52fa402b29e', '1468e28b-6508-4aa7-88d2-6b6729a8e3b6'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:08:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c9694bce-e450-4e38-97f6-a3ce241cd36f tempest-GroupSnapshotsV319Test-1709429969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c9694bce-e450-4e38-97f6-a3ce241cd36f tempest-GroupSnapshotsV319Test-1709429969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:28 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c9694bce-e450-4e38-97f6-a3ce241cd36f tempest-GroupSnapshotsV319Test-1709429969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:08:28 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c9694bce-e450-4e38-97f6-a3ce241cd36f tempest-GroupSnapshotsV319Test-1709429969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:08:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c9694bce-e450-4e38-97f6-a3ce241cd36f tempest-GroupSnapshotsV319Test-1709429969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c9694bce-e450-4e38-97f6-a3ce241cd36f tempest-GroupSnapshotsV319Test-1709429969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:29 devstack sudo[85646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:08:29 devstack sudo[85646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:29 devstack sudo[85632]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861" returned: 0 in 0.649s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:29 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861" released by "_copy_volume_from_snapshot" :: held 10.467s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:29 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-09463d88-34b8-4767-9da3-825074ecb6b6-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861" released by "_create_volume_from_snapshot" :: held 10.529s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.556s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.206s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:29 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-840992025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d141c6-b433-4ccd-ae75-fc81e8ed2e88,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1d009419ab1468fa1e45e954f9d3906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:08:18Z,use_quota=True,user_id='16b1b751eb6340b9a26c33d803d94f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:08:29 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Creating volume 38d141c6-b433-4ccd-ae75-fc81e8ed2e88 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:08:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:29 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:08:29 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:08:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:29 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:08:29 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:08:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-38d141c6-b433-4ccd-ae75-fc81e8ed2e88 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:29 devstack sudo[85666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-38d141c6-b433-4ccd-ae75-fc81e8ed2e88 1073741824 Apr 27 10:08:29 devstack sudo[85666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (305e25e9-2fbc-4b82-960e-63b5fe6a54db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861', 'volume_size': 1, 'snapshot_id': '09463d88-34b8-4767-9da3-825074ecb6b6'}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ebe5bb-2110-4459-b613-9adee5a181e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:29 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Volume volume-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861 (5dd30554-d4e4-4cb8-8a91-c7aaba4ed861): created successfully Apr 27 10:08:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ebe5bb-2110-4459-b613-9adee5a181e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Flow 'volume_create_manager' (0ba45844-da60-4340-a851-7683b2913fe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:08:29 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-f9fe6dc9-69e6-409b-bcc2-afd7e0589da2 tempest-VolumesSnapshotTestJSON-1648254463 None] Created volume successfully. Apr 27 10:08:29 devstack sudo[85646]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c9694bce-e450-4e38-97f6-a3ce241cd36f tempest-GroupSnapshotsV319Test-1709429969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.599s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:29 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-c9694bce-e450-4e38-97f6-a3ce241cd36f tempest-GroupSnapshotsV319Test-1709429969 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:08:29 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-c9694bce-e450-4e38-97f6-a3ce241cd36f tempest-GroupSnapshotsV319Test-1709429969 None] Delete group completed successfully. Apr 27 10:08:29 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3695cc79-8eee-4925-8c96-b8c839b35f66 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "cinder-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3695cc79-8eee-4925-8c96-b8c839b35f66 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:30 devstack sudo[85666]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-38d141c6-b433-4ccd-ae75-fc81e8ed2e88 1073741824" returned: 0 in 0.854s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3695cc79-8eee-4925-8c96-b8c839b35f66 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "cinder-quobyte-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-38d141c6-b433-4ccd-ae75-fc81e8ed2e88 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3695cc79-8eee-4925-8c96-b8c839b35f66 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861" acquired by "delete_volume" :: waited 0.045s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:30 devstack sudo[85678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-38d141c6-b433-4ccd-ae75-fc81e8ed2e88 Apr 27 10:08:30 devstack sudo[85678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:30 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed87311-0518-41bb-9b64-397f456ac438]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3695cc79-8eee-4925-8c96-b8c839b35f66 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:30 devstack sudo[85683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861 Apr 27 10:08:30 devstack sudo[85683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:30 devstack sudo[85678]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-38d141c6-b433-4ccd-ae75-fc81e8ed2e88" returned: 0 in 0.625s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:30 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:08:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:30 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600ee62e-0e1e-4d22-b1c5-a85e9b491939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38d141c6-b433-4ccd-ae75-fc81e8ed2e88', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:30 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb96325-d67c-4e7a-be8e-7f24d1751c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:30 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Volume volume-38d141c6-b433-4ccd-ae75-fc81e8ed2e88 (38d141c6-b433-4ccd-ae75-fc81e8ed2e88): created successfully Apr 27 10:08:30 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb96325-d67c-4e7a-be8e-7f24d1751c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:30 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Flow 'volume_create_manager' (b1357fe3-7d79-435d-b3d5-c1da6290b898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:08:30 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-913e16c1-3ded-4e18-bc70-7abd81d6cef4 tempest-VolumesTestJSON-384176937 None] Created volume successfully. Apr 27 10:08:30 devstack sudo[85683]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3695cc79-8eee-4925-8c96-b8c839b35f66 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861" returned: 0 in 0.793s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3695cc79-8eee-4925-8c96-b8c839b35f66 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:30 devstack sudo[85699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861 Apr 27 10:08:30 devstack sudo[85699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:31 devstack sudo[85699]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3695cc79-8eee-4925-8c96-b8c839b35f66 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861" returned: 0 in 0.738s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3695cc79-8eee-4925-8c96-b8c839b35f66 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861" released by "delete_volume" :: held 1.623s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:31 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-3695cc79-8eee-4925-8c96-b8c839b35f66 tempest-VolumesSnapshotTestJSON-1648254463 None] Created reservations ['bf3ddade-bc29-41ad-b517-7db45bb0f7e2', 'ac7131ab-9701-4900-a106-05dc02c2a795', '871ed981-d4de-4cf0-9d05-299d726f2d8d', '6f36b736-68df-4854-90d4-ca8340cc8f50'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3695cc79-8eee-4925-8c96-b8c839b35f66 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3695cc79-8eee-4925-8c96-b8c839b35f66 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3695cc79-8eee-4925-8c96-b8c839b35f66 tempest-VolumesSnapshotTestJSON-1648254463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3695cc79-8eee-4925-8c96-b8c839b35f66 tempest-VolumesSnapshotTestJSON-1648254463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3695cc79-8eee-4925-8c96-b8c839b35f66 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3695cc79-8eee-4925-8c96-b8c839b35f66 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:32 devstack sudo[85730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:08:32 devstack sudo[85730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Flow 'volume_create_manager' (be0ef056-aba3-4f83-84e3-447c51c79a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d2767f2-7b01-4cfd-9f97-3c71799d342f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-73cb27b2-f538-4d38-84cc-95b0dd5b5391 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "cinder-09463d88-34b8-4767-9da3-825074ecb6b6-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d2767f2-7b01-4cfd-9f97-3c71799d342f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-185036837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1d009419ab1468fa1e45e954f9d3906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:08:32Z,use_quota=True,user_id='16b1b751eb6340b9a26c33d803d94f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e79cc12a-0f5f-4355-b275-415fbce46b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e79cc12a-0f5f-4355-b275-415fbce46b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc4ca33-1d64-4c87-8afe-805c6629444e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc4ca33-1d64-4c87-8afe-805c6629444e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee', 'volume_name': 'volume-3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2bad86e-ebdc-4cdb-adb3-481c02c1f70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2bad86e-ebdc-4cdb-adb3-481c02c1f70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8ad6712-65dd-4f7f-9816-87bcba91032f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:32 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Volume 3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee', 'volume_size': 1} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-185036837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1d009419ab1468fa1e45e954f9d3906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:08:32Z,use_quota=True,user_id='16b1b751eb6340b9a26c33d803d94f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Creating volume 3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:08:32 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-73cb27b2-f538-4d38-84cc-95b0dd5b5391 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-09463d88-34b8-4767-9da3-825074ecb6b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.104s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-73cb27b2-f538-4d38-84cc-95b0dd5b5391 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "cinder-quobyte-d44a31f5-2230-4a44-84bb-2127f3e228d2" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:32 devstack sudo[85732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee 1073741824 Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-73cb27b2-f538-4d38-84cc-95b0dd5b5391 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-d44a31f5-2230-4a44-84bb-2127f3e228d2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-73cb27b2-f538-4d38-84cc-95b0dd5b5391 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "cinder-quobyte-09463d88-34b8-4767-9da3-825074ecb6b6" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:32 devstack sudo[85732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-73cb27b2-f538-4d38-84cc-95b0dd5b5391 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-09463d88-34b8-4767-9da3-825074ecb6b6" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-73cb27b2-f538-4d38-84cc-95b0dd5b5391 tempest-VolumesSnapshotTestJSON-1648254463 None] Deleting offline snapshot 09463d88-34b8-4767-9da3-825074ecb6b6 of volume d44a31f5-2230-4a44-84bb-2127f3e228d2 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-73cb27b2-f538-4d38-84cc-95b0dd5b5391 tempest-VolumesSnapshotTestJSON-1648254463 None] snapshot_file for this snap is: volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.09463d88-34b8-4767-9da3-825074ecb6b6 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[179214af-e1d7-4a34-8536-3e3cc662137b]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-73cb27b2-f538-4d38-84cc-95b0dd5b5391 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.09463d88-34b8-4767-9da3-825074ecb6b6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:32 devstack sudo[85730]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3695cc79-8eee-4925-8c96-b8c839b35f66 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.881s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:32 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-3695cc79-8eee-4925-8c96-b8c839b35f66 tempest-VolumesSnapshotTestJSON-1648254463 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:08:32 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-3695cc79-8eee-4925-8c96-b8c839b35f66 tempest-VolumesSnapshotTestJSON-1648254463 None] Deleted volume successfully. Apr 27 10:08:33 devstack sudo[85735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.09463d88-34b8-4767-9da3-825074ecb6b6 Apr 27 10:08:33 devstack sudo[85735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:33 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3695cc79-8eee-4925-8c96-b8c839b35f66 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-5dd30554-d4e4-4cb8-8a91-c7aaba4ed861-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:33 devstack sudo[85735]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-73cb27b2-f538-4d38-84cc-95b0dd5b5391 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.09463d88-34b8-4767-9da3-825074ecb6b6" returned: 0 in 0.876s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:33 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-73cb27b2-f538-4d38-84cc-95b0dd5b5391 tempest-VolumesSnapshotTestJSON-1648254463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d44a31f5-2230-4a44-84bb-2127f3e228d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:08:33 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3386e1-40b0-43bf-ad7a-cf37eec98ba8]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-73cb27b2-f538-4d38-84cc-95b0dd5b5391 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:33 devstack sudo[85732]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee 1073741824" returned: 0 in 1.170s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:33 devstack sudo[85746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee Apr 27 10:08:33 devstack sudo[85746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:33 devstack sudo[85745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 Apr 27 10:08:33 devstack sudo[85745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:34 devstack sudo[85746]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee" returned: 0 in 0.608s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:08:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8ad6712-65dd-4f7f-9816-87bcba91032f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f50a0b-8d87-483b-8304-4cc1ee385fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:34 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Volume volume-3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee (3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee): created successfully Apr 27 10:08:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f50a0b-8d87-483b-8304-4cc1ee385fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Flow 'volume_create_manager' (be0ef056-aba3-4f83-84e3-447c51c79a0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:08:34 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-88de95f9-f1f0-4fd1-b641-cca3604994cc tempest-VolumesTestJSON-384176937 None] Created volume successfully. Apr 27 10:08:34 devstack sudo[85745]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-73cb27b2-f538-4d38-84cc-95b0dd5b5391 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2" returned: 0 in 0.854s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-73cb27b2-f538-4d38-84cc-95b0dd5b5391 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.09463d88-34b8-4767-9da3-825074ecb6b6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:34 devstack sudo[85759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.09463d88-34b8-4767-9da3-825074ecb6b6 Apr 27 10:08:34 devstack sudo[85759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:35 devstack sudo[85759]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-73cb27b2-f538-4d38-84cc-95b0dd5b5391 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.09463d88-34b8-4767-9da3-825074ecb6b6" returned: 0 in 0.623s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-73cb27b2-f538-4d38-84cc-95b0dd5b5391 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.09463d88-34b8-4767-9da3-825074ecb6b6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:35 devstack sudo[85766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.09463d88-34b8-4767-9da3-825074ecb6b6 Apr 27 10:08:35 devstack sudo[85766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:35 devstack sudo[85766]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-73cb27b2-f538-4d38-84cc-95b0dd5b5391 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2.09463d88-34b8-4767-9da3-825074ecb6b6" returned: 0 in 0.538s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-73cb27b2-f538-4d38-84cc-95b0dd5b5391 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-09463d88-34b8-4767-9da3-825074ecb6b6" released by "_delete_snapshot" :: held 3.065s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-73cb27b2-f538-4d38-84cc-95b0dd5b5391 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-d44a31f5-2230-4a44-84bb-2127f3e228d2" released by "delete_snapshot" :: held 3.116s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:35 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-73cb27b2-f538-4d38-84cc-95b0dd5b5391 tempest-VolumesSnapshotTestJSON-1648254463 None] Created reservations ['b1a66fab-3088-4375-99ac-05067d85b77a', '22e994f1-39ed-4b9a-99d0-fdacb1bededc', 'd99d4be1-3c12-4974-84b5-40dde6f315fa', '9cb2656a-a160-4f8f-843b-ff4ab0f2d49b'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:08:35 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-73cb27b2-f538-4d38-84cc-95b0dd5b5391 tempest-VolumesSnapshotTestJSON-1648254463 None] Delete snapshot completed successfully. Apr 27 10:08:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-73cb27b2-f538-4d38-84cc-95b0dd5b5391 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-09463d88-34b8-4767-9da3-825074ecb6b6-delete_snapshot" released by "delete_snapshot" :: held 3.275s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Flow 'volume_create_manager' (958ef42d-b7fe-4ee4-8772-7adfd64b5934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828e29a3-44a5-40fa-9b5a-862b683933dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828e29a3-44a5-40fa-9b5a-862b683933dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-398823139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4818362d-50c6-4af1-9f38-d51ff788e16e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1d009419ab1468fa1e45e954f9d3906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:08:36Z,use_quota=True,user_id='16b1b751eb6340b9a26c33d803d94f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979e3d9c-53d5-408f-bf6b-2e276e7e614b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979e3d9c-53d5-408f-bf6b-2e276e7e614b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49423a81-044b-400f-8601-ff126882df2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49423a81-044b-400f-8601-ff126882df2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4818362d-50c6-4af1-9f38-d51ff788e16e', 'volume_name': 'volume-4818362d-50c6-4af1-9f38-d51ff788e16e', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e812b5e-082a-46e5-9a47-a7ede7f8be86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e812b5e-082a-46e5-9a47-a7ede7f8be86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571e26a0-a9be-4fe7-9c18-97a3bf15b909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:36 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Volume 4818362d-50c6-4af1-9f38-d51ff788e16e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4818362d-50c6-4af1-9f38-d51ff788e16e', 'volume_size': 1} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-398823139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4818362d-50c6-4af1-9f38-d51ff788e16e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1d009419ab1468fa1e45e954f9d3906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:08:36Z,use_quota=True,user_id='16b1b751eb6340b9a26c33d803d94f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Creating volume 4818362d-50c6-4af1-9f38-d51ff788e16e {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:08:36 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4818362d-50c6-4af1-9f38-d51ff788e16e 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:36 devstack sudo[85769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4818362d-50c6-4af1-9f38-d51ff788e16e 1073741824 Apr 27 10:08:36 devstack sudo[85769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a3f6b80b-9643-4657-b379-e6136742b7f5 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "cinder-d44a31f5-2230-4a44-84bb-2127f3e228d2-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a3f6b80b-9643-4657-b379-e6136742b7f5 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-d44a31f5-2230-4a44-84bb-2127f3e228d2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:36 devstack sudo[85769]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4818362d-50c6-4af1-9f38-d51ff788e16e 1073741824" returned: 0 in 0.695s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a3f6b80b-9643-4657-b379-e6136742b7f5 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "cinder-quobyte-d44a31f5-2230-4a44-84bb-2127f3e228d2" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4818362d-50c6-4af1-9f38-d51ff788e16e {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a3f6b80b-9643-4657-b379-e6136742b7f5 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-d44a31f5-2230-4a44-84bb-2127f3e228d2" acquired by "delete_volume" :: waited 0.037s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:36 devstack sudo[85774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4818362d-50c6-4af1-9f38-d51ff788e16e Apr 27 10:08:36 devstack sudo[85774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:37 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[04167781-3727-4b6c-88cf-039546844ca1]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a3f6b80b-9643-4657-b379-e6136742b7f5 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:37 devstack sudo[85784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 Apr 27 10:08:37 devstack sudo[85784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:37 devstack sudo[85774]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4818362d-50c6-4af1-9f38-d51ff788e16e" returned: 0 in 0.668s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:37 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:08:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:37 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571e26a0-a9be-4fe7-9c18-97a3bf15b909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4818362d-50c6-4af1-9f38-d51ff788e16e', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:37 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f88bdf-7cf7-4289-9a11-a235941fc37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:37 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Volume volume-4818362d-50c6-4af1-9f38-d51ff788e16e (4818362d-50c6-4af1-9f38-d51ff788e16e): created successfully Apr 27 10:08:37 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f88bdf-7cf7-4289-9a11-a235941fc37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:37 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Flow 'volume_create_manager' (958ef42d-b7fe-4ee4-8772-7adfd64b5934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:08:37 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-311c624c-0c98-476c-b50b-5d40c6c40055 tempest-VolumesTestJSON-384176937 None] Created volume successfully. Apr 27 10:08:37 devstack sudo[85784]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a3f6b80b-9643-4657-b379-e6136742b7f5 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2" returned: 0 in 0.688s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a3f6b80b-9643-4657-b379-e6136742b7f5 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:37 devstack sudo[85791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2 Apr 27 10:08:37 devstack sudo[85791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:38 devstack sudo[85791]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a3f6b80b-9643-4657-b379-e6136742b7f5 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d44a31f5-2230-4a44-84bb-2127f3e228d2" returned: 0 in 0.557s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:38 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a3f6b80b-9643-4657-b379-e6136742b7f5 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-d44a31f5-2230-4a44-84bb-2127f3e228d2" released by "delete_volume" :: held 1.327s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:38 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-a3f6b80b-9643-4657-b379-e6136742b7f5 tempest-VolumesSnapshotTestJSON-1648254463 None] Created reservations ['c674a7d8-bcba-43d6-9fd3-75b56979b78d', '13d01261-7a22-42e4-80e5-595b75dd0c86', '8f8be155-2a90-4717-8943-16d9f6f38ab1', '064710b5-6219-4bb3-91cb-0b5950c3940c'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:08:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-a3f6b80b-9643-4657-b379-e6136742b7f5 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-a3f6b80b-9643-4657-b379-e6136742b7f5 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:38 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-a3f6b80b-9643-4657-b379-e6136742b7f5 tempest-VolumesSnapshotTestJSON-1648254463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:08:38 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-a3f6b80b-9643-4657-b379-e6136742b7f5 tempest-VolumesSnapshotTestJSON-1648254463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:08:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-a3f6b80b-9643-4657-b379-e6136742b7f5 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a3f6b80b-9643-4657-b379-e6136742b7f5 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:38 devstack sudo[85794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:08:38 devstack sudo[85794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:39 devstack sudo[85794]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a3f6b80b-9643-4657-b379-e6136742b7f5 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.706s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:39 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-a3f6b80b-9643-4657-b379-e6136742b7f5 tempest-VolumesSnapshotTestJSON-1648254463 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:08:39 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-a3f6b80b-9643-4657-b379-e6136742b7f5 tempest-VolumesSnapshotTestJSON-1648254463 None] Deleted volume successfully. Apr 27 10:08:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a3f6b80b-9643-4657-b379-e6136742b7f5 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-d44a31f5-2230-4a44-84bb-2127f3e228d2-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c24dd32d-73db-428b-afa1-5845eacfbef4 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "cinder-8f1feb22-2fae-4023-bf35-8c6e0594943e-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c24dd32d-73db-428b-afa1-5845eacfbef4 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-8f1feb22-2fae-4023-bf35-8c6e0594943e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c24dd32d-73db-428b-afa1-5845eacfbef4 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "cinder-quobyte-8f1feb22-2fae-4023-bf35-8c6e0594943e" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c24dd32d-73db-428b-afa1-5845eacfbef4 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-8f1feb22-2fae-4023-bf35-8c6e0594943e" acquired by "delete_volume" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:39 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[658d6cd3-759d-4834-9693-4e6a332dd8ee]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c24dd32d-73db-428b-afa1-5845eacfbef4 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-90eefe4a-9038-45e1-8d81-366e2072f8f3 tempest-VolumesTestJSON-384176937 None] Acquiring lock "cinder-4818362d-50c6-4af1-9f38-d51ff788e16e-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:39 devstack sudo[85797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e Apr 27 10:08:39 devstack sudo[85797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-90eefe4a-9038-45e1-8d81-366e2072f8f3 tempest-VolumesTestJSON-384176937 None] Lock "cinder-4818362d-50c6-4af1-9f38-d51ff788e16e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-90eefe4a-9038-45e1-8d81-366e2072f8f3 tempest-VolumesTestJSON-384176937 None] Acquiring lock "cinder-quobyte-4818362d-50c6-4af1-9f38-d51ff788e16e" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-90eefe4a-9038-45e1-8d81-366e2072f8f3 tempest-VolumesTestJSON-384176937 None] Lock "cinder-quobyte-4818362d-50c6-4af1-9f38-d51ff788e16e" acquired by "delete_volume" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:39 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16d4d4b-043b-4e8e-877a-784f309fa025]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-90eefe4a-9038-45e1-8d81-366e2072f8f3 tempest-VolumesTestJSON-384176937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4818362d-50c6-4af1-9f38-d51ff788e16e {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:39 devstack sudo[85799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4818362d-50c6-4af1-9f38-d51ff788e16e Apr 27 10:08:39 devstack sudo[85799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:40 devstack sudo[85797]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c24dd32d-73db-428b-afa1-5845eacfbef4 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e" returned: 0 in 0.652s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c24dd32d-73db-428b-afa1-5845eacfbef4 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:40 devstack sudo[85804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e Apr 27 10:08:40 devstack sudo[85804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:40 devstack sudo[85799]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-90eefe4a-9038-45e1-8d81-366e2072f8f3 tempest-VolumesTestJSON-384176937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4818362d-50c6-4af1-9f38-d51ff788e16e" returned: 0 in 0.840s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-90eefe4a-9038-45e1-8d81-366e2072f8f3 tempest-VolumesTestJSON-384176937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4818362d-50c6-4af1-9f38-d51ff788e16e {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:40 devstack sudo[85809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4818362d-50c6-4af1-9f38-d51ff788e16e Apr 27 10:08:40 devstack sudo[85809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:40 devstack sudo[85804]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c24dd32d-73db-428b-afa1-5845eacfbef4 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8f1feb22-2fae-4023-bf35-8c6e0594943e" returned: 0 in 0.699s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:40 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c24dd32d-73db-428b-afa1-5845eacfbef4 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-quobyte-8f1feb22-2fae-4023-bf35-8c6e0594943e" released by "delete_volume" :: held 1.435s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:40 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-c24dd32d-73db-428b-afa1-5845eacfbef4 tempest-VolumesSnapshotTestJSON-1648254463 None] Created reservations ['d555e63d-a3a7-41e3-b413-0967a7440206', '043fa2c3-42f8-4909-9238-de9e86949924', '99060181-f7a3-4694-bdf4-a3d6aa5eed9a', '2e5b1d2e-4edd-42ab-b38e-3f9daf9c9854'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:08:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c24dd32d-73db-428b-afa1-5845eacfbef4 tempest-VolumesSnapshotTestJSON-1648254463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c24dd32d-73db-428b-afa1-5845eacfbef4 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:40 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c24dd32d-73db-428b-afa1-5845eacfbef4 tempest-VolumesSnapshotTestJSON-1648254463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:08:40 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c24dd32d-73db-428b-afa1-5845eacfbef4 tempest-VolumesSnapshotTestJSON-1648254463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:08:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c24dd32d-73db-428b-afa1-5845eacfbef4 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c24dd32d-73db-428b-afa1-5845eacfbef4 tempest-VolumesSnapshotTestJSON-1648254463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:41 devstack sudo[85817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:08:41 devstack sudo[85817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:41 devstack sudo[85809]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-90eefe4a-9038-45e1-8d81-366e2072f8f3 tempest-VolumesTestJSON-384176937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4818362d-50c6-4af1-9f38-d51ff788e16e" returned: 0 in 0.685s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:41 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-90eefe4a-9038-45e1-8d81-366e2072f8f3 tempest-VolumesTestJSON-384176937 None] Lock "cinder-quobyte-4818362d-50c6-4af1-9f38-d51ff788e16e" released by "delete_volume" :: held 1.572s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:41 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-90eefe4a-9038-45e1-8d81-366e2072f8f3 tempest-VolumesTestJSON-384176937 None] Created reservations ['4593fc58-a8aa-4598-83d0-e20d0488dbad', '33bc92f6-0dfc-4034-961f-21df7d9c772c', '0bbb890f-7edc-44af-95bc-5f82eaa6fd61', '448d16b5-aa18-47b4-9ced-4dff0386cde3'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:08:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-90eefe4a-9038-45e1-8d81-366e2072f8f3 tempest-VolumesTestJSON-384176937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-90eefe4a-9038-45e1-8d81-366e2072f8f3 tempest-VolumesTestJSON-384176937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-90eefe4a-9038-45e1-8d81-366e2072f8f3 tempest-VolumesTestJSON-384176937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:08:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-90eefe4a-9038-45e1-8d81-366e2072f8f3 tempest-VolumesTestJSON-384176937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:08:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-90eefe4a-9038-45e1-8d81-366e2072f8f3 tempest-VolumesTestJSON-384176937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-90eefe4a-9038-45e1-8d81-366e2072f8f3 tempest-VolumesTestJSON-384176937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:41 devstack sudo[85830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:08:41 devstack sudo[85830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:41 devstack sudo[85817]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c24dd32d-73db-428b-afa1-5845eacfbef4 tempest-VolumesSnapshotTestJSON-1648254463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.558s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:41 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-c24dd32d-73db-428b-afa1-5845eacfbef4 tempest-VolumesSnapshotTestJSON-1648254463 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:08:41 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-c24dd32d-73db-428b-afa1-5845eacfbef4 tempest-VolumesSnapshotTestJSON-1648254463 None] Deleted volume successfully. Apr 27 10:08:41 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c24dd32d-73db-428b-afa1-5845eacfbef4 tempest-VolumesSnapshotTestJSON-1648254463 None] Lock "cinder-8f1feb22-2fae-4023-bf35-8c6e0594943e-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:41 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-66ffff5a-ac14-4373-8ec9-88ed08303477 tempest-VolumesTestJSON-384176937 None] Acquiring lock "cinder-3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:41 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-66ffff5a-ac14-4373-8ec9-88ed08303477 tempest-VolumesTestJSON-384176937 None] Lock "cinder-3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:41 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-66ffff5a-ac14-4373-8ec9-88ed08303477 tempest-VolumesTestJSON-384176937 None] Acquiring lock "cinder-quobyte-3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:42 devstack sudo[85830]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:42 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-66ffff5a-ac14-4373-8ec9-88ed08303477 tempest-VolumesTestJSON-384176937 None] Lock "cinder-quobyte-3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee" acquired by "delete_volume" :: waited 0.039s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-90eefe4a-9038-45e1-8d81-366e2072f8f3 tempest-VolumesTestJSON-384176937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.706s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:42 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-90eefe4a-9038-45e1-8d81-366e2072f8f3 tempest-VolumesTestJSON-384176937 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:08:42 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-90eefe4a-9038-45e1-8d81-366e2072f8f3 tempest-VolumesTestJSON-384176937 None] Deleted volume successfully. Apr 27 10:08:42 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d342903e-4a7c-4a13-bd28-8079ce4ee7f3]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-66ffff5a-ac14-4373-8ec9-88ed08303477 tempest-VolumesTestJSON-384176937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:42 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-90eefe4a-9038-45e1-8d81-366e2072f8f3 tempest-VolumesTestJSON-384176937 None] Lock "cinder-4818362d-50c6-4af1-9f38-d51ff788e16e-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:42 devstack sudo[85836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee Apr 27 10:08:42 devstack sudo[85836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:42 devstack sudo[85836]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-66ffff5a-ac14-4373-8ec9-88ed08303477 tempest-VolumesTestJSON-384176937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee" returned: 0 in 0.627s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-66ffff5a-ac14-4373-8ec9-88ed08303477 tempest-VolumesTestJSON-384176937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:42 devstack sudo[85841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee Apr 27 10:08:42 devstack sudo[85841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:43 devstack sudo[85841]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-66ffff5a-ac14-4373-8ec9-88ed08303477 tempest-VolumesTestJSON-384176937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee" returned: 0 in 0.494s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-66ffff5a-ac14-4373-8ec9-88ed08303477 tempest-VolumesTestJSON-384176937 None] Lock "cinder-quobyte-3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee" released by "delete_volume" :: held 1.169s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:43 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-66ffff5a-ac14-4373-8ec9-88ed08303477 tempest-VolumesTestJSON-384176937 None] Created reservations ['b451c086-bcf7-4c03-a957-1047815682a0', '17441104-b5ae-414e-affc-60d54fe5e697', 'ed71ea0e-8e71-4cf0-b5ae-67e5fdff12e8', 'b5961f40-83e8-402d-9637-6fa5756123f7'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:08:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-66ffff5a-ac14-4373-8ec9-88ed08303477 tempest-VolumesTestJSON-384176937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-66ffff5a-ac14-4373-8ec9-88ed08303477 tempest-VolumesTestJSON-384176937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:43 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-66ffff5a-ac14-4373-8ec9-88ed08303477 tempest-VolumesTestJSON-384176937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:08:43 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-66ffff5a-ac14-4373-8ec9-88ed08303477 tempest-VolumesTestJSON-384176937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:08:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-66ffff5a-ac14-4373-8ec9-88ed08303477 tempest-VolumesTestJSON-384176937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-66ffff5a-ac14-4373-8ec9-88ed08303477 tempest-VolumesTestJSON-384176937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:43 devstack sudo[85846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:08:43 devstack sudo[85846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:43 devstack sudo[85846]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-66ffff5a-ac14-4373-8ec9-88ed08303477 tempest-VolumesTestJSON-384176937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.545s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:43 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-66ffff5a-ac14-4373-8ec9-88ed08303477 tempest-VolumesTestJSON-384176937 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:08:43 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-66ffff5a-ac14-4373-8ec9-88ed08303477 tempest-VolumesTestJSON-384176937 None] Deleted volume successfully. Apr 27 10:08:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-66ffff5a-ac14-4373-8ec9-88ed08303477 tempest-VolumesTestJSON-384176937 None] Lock "cinder-3bb97d6f-b43b-4bbf-906e-a8f8c0df08ee-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:44 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-24934a09-1579-4202-8ece-324c08ca99e8 tempest-VolumesTestJSON-384176937 None] Acquiring lock "cinder-38d141c6-b433-4ccd-ae75-fc81e8ed2e88-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:44 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-24934a09-1579-4202-8ece-324c08ca99e8 tempest-VolumesTestJSON-384176937 None] Lock "cinder-38d141c6-b433-4ccd-ae75-fc81e8ed2e88-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:44 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-24934a09-1579-4202-8ece-324c08ca99e8 tempest-VolumesTestJSON-384176937 None] Acquiring lock "cinder-quobyte-38d141c6-b433-4ccd-ae75-fc81e8ed2e88" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:44 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-24934a09-1579-4202-8ece-324c08ca99e8 tempest-VolumesTestJSON-384176937 None] Lock "cinder-quobyte-38d141c6-b433-4ccd-ae75-fc81e8ed2e88" acquired by "delete_volume" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:44 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f770d860-399c-4581-a3ac-8d113378a343]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-24934a09-1579-4202-8ece-324c08ca99e8 tempest-VolumesTestJSON-384176937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-38d141c6-b433-4ccd-ae75-fc81e8ed2e88 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:44 devstack sudo[85849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-38d141c6-b433-4ccd-ae75-fc81e8ed2e88 Apr 27 10:08:44 devstack sudo[85849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:44 devstack sudo[85849]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-24934a09-1579-4202-8ece-324c08ca99e8 tempest-VolumesTestJSON-384176937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-38d141c6-b433-4ccd-ae75-fc81e8ed2e88" returned: 0 in 0.742s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-24934a09-1579-4202-8ece-324c08ca99e8 tempest-VolumesTestJSON-384176937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-38d141c6-b433-4ccd-ae75-fc81e8ed2e88 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:45 devstack sudo[85855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-38d141c6-b433-4ccd-ae75-fc81e8ed2e88 Apr 27 10:08:45 devstack sudo[85855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:45 devstack sudo[85855]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-24934a09-1579-4202-8ece-324c08ca99e8 tempest-VolumesTestJSON-384176937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-38d141c6-b433-4ccd-ae75-fc81e8ed2e88" returned: 0 in 0.513s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:45 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-24934a09-1579-4202-8ece-324c08ca99e8 tempest-VolumesTestJSON-384176937 None] Lock "cinder-quobyte-38d141c6-b433-4ccd-ae75-fc81e8ed2e88" released by "delete_volume" :: held 1.298s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:45 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-24934a09-1579-4202-8ece-324c08ca99e8 tempest-VolumesTestJSON-384176937 None] Created reservations ['b958273c-f2b9-49a8-b439-1fb85db3c395', '3ce30fec-87e9-470b-b017-fa25075a7cd9', '6dfc6e85-6305-48d5-99ed-eae0ac8b9192', 'd32b74d2-3719-4200-a8e5-5df2a8f3e797'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:08:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-24934a09-1579-4202-8ece-324c08ca99e8 tempest-VolumesTestJSON-384176937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-24934a09-1579-4202-8ece-324c08ca99e8 tempest-VolumesTestJSON-384176937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:45 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-24934a09-1579-4202-8ece-324c08ca99e8 tempest-VolumesTestJSON-384176937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:08:45 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-24934a09-1579-4202-8ece-324c08ca99e8 tempest-VolumesTestJSON-384176937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:08:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-24934a09-1579-4202-8ece-324c08ca99e8 tempest-VolumesTestJSON-384176937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-24934a09-1579-4202-8ece-324c08ca99e8 tempest-VolumesTestJSON-384176937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:45 devstack sudo[85859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:08:45 devstack sudo[85859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:46 devstack sudo[85859]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-24934a09-1579-4202-8ece-324c08ca99e8 tempest-VolumesTestJSON-384176937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.697s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:46 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-24934a09-1579-4202-8ece-324c08ca99e8 tempest-VolumesTestJSON-384176937 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:08:46 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-24934a09-1579-4202-8ece-324c08ca99e8 tempest-VolumesTestJSON-384176937 None] Deleted volume successfully. Apr 27 10:08:46 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-24934a09-1579-4202-8ece-324c08ca99e8 tempest-VolumesTestJSON-384176937 None] Lock "cinder-38d141c6-b433-4ccd-ae75-fc81e8ed2e88-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:08:47 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-db065db3-b092-4fab-9758-416f728280d0 tempest-GroupsV320Test-1084108171 None] Group tempest-GroupsV320Test-Group-399244035: creating Apr 27 10:08:47 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-db065db3-b092-4fab-9758-416f728280d0 tempest-GroupsV320Test-1084108171 None] Group tempest-GroupsV320Test-Group-399244035: created successfully Apr 27 10:08:47 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-db065db3-b092-4fab-9758-416f728280d0 tempest-GroupsV320Test-1084108171 None] Create group completed successfully. Apr 27 10:08:48 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:08:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Flow 'volume_create_manager' (521909d9-b603-4eab-a6d4-60277bbf6468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:08:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44dc9e59-ec5f-4523-86da-a6a54f224ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44dc9e59-ec5f-4523-86da-a6a54f224ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1607786717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1463fc-8866-4057-8b10-2bb5bcc2c4a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ff302c363140919bd6f20b0ca48a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:08:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:08:48Z,use_quota=True,user_id='d82f2a8124ff42fbaf1b8201eaacd202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b708ed92-9ba7-479a-aae8-4ac93ba9d241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b708ed92-9ba7-479a-aae8-4ac93ba9d241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3dc32c8-eda5-46e9-9f2a-64792e662221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3dc32c8-eda5-46e9-9f2a-64792e662221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a1463fc-8866-4057-8b10-2bb5bcc2c4a1', 'volume_name': 'volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1', 'volume_size': 2}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5973d2a7-932d-4f27-885a-ff1729ffb605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5973d2a7-932d-4f27-885a-ff1729ffb605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed8aab34-7ffa-4d81-be7a-d18f7fd03907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:48 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Volume 7a1463fc-8866-4057-8b10-2bb5bcc2c4a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1', 'volume_size': 2} Apr 27 10:08:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1607786717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1463fc-8866-4057-8b10-2bb5bcc2c4a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ff302c363140919bd6f20b0ca48a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:08:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:08:48Z,use_quota=True,user_id='d82f2a8124ff42fbaf1b8201eaacd202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:08:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Creating volume 7a1463fc-8866-4057-8b10-2bb5bcc2c4a1 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:08:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:08:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:08:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:08:48 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:08:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1 2147483648 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:48 devstack sudo[85880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1 2147483648 Apr 27 10:08:48 devstack sudo[85880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:49 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-c9a6ca4b-293b-4d0b-9983-2dc133fc3116 tempest-GroupsV320Test-1084108171 None] Created reservations ['31ab9196-1f18-4c41-82b2-d51d2672122b'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:08:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c9a6ca4b-293b-4d0b-9983-2dc133fc3116 tempest-GroupsV320Test-1084108171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c9a6ca4b-293b-4d0b-9983-2dc133fc3116 tempest-GroupsV320Test-1084108171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:49 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c9a6ca4b-293b-4d0b-9983-2dc133fc3116 tempest-GroupsV320Test-1084108171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:08:49 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c9a6ca4b-293b-4d0b-9983-2dc133fc3116 tempest-GroupsV320Test-1084108171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:08:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c9a6ca4b-293b-4d0b-9983-2dc133fc3116 tempest-GroupsV320Test-1084108171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c9a6ca4b-293b-4d0b-9983-2dc133fc3116 tempest-GroupsV320Test-1084108171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:49 devstack sudo[85916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:08:49 devstack sudo[85916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:49 devstack sudo[85880]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1 2147483648" returned: 0 in 1.259s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:50 devstack sudo[85918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1 Apr 27 10:08:50 devstack sudo[85918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:50 devstack sudo[85916]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c9a6ca4b-293b-4d0b-9983-2dc133fc3116 tempest-GroupsV320Test-1084108171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.727s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:50 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-c9a6ca4b-293b-4d0b-9983-2dc133fc3116 tempest-GroupsV320Test-1084108171 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:08:50 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-c9a6ca4b-293b-4d0b-9983-2dc133fc3116 tempest-GroupsV320Test-1084108171 None] Delete group completed successfully. Apr 27 10:08:50 devstack sudo[85918]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1" returned: 0 in 0.761s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:50 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] <== create_volume: return (2110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:08:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.112s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed8aab34-7ffa-4d81-be7a-d18f7fd03907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1', 'volume_size': 2}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9924953e-800a-4c2b-abb5-1a29d62e3392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:50 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Volume volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1 (7a1463fc-8866-4057-8b10-2bb5bcc2c4a1): created successfully Apr 27 10:08:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9924953e-800a-4c2b-abb5-1a29d62e3392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Flow 'volume_create_manager' (521909d9-b603-4eab-a6d4-60277bbf6468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:08:50 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-17ca5473-d91b-4692-a9f9-0bfe0afd9432 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Created volume successfully. Apr 27 10:08:52 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-ec670ebc-c02e-42d3-97eb-74197ce094e7 tempest-GroupsV314Test-1306254640 None] Group tempest-GroupsV314Test-Group-52453031: creating Apr 27 10:08:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-cca46c9b-512c-403d-ad91-eee43def228c tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-cca46c9b-512c-403d-ad91-eee43def228c tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:52 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-cca46c9b-512c-403d-ad91-eee43def228c tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Creating offline snapshot 2b909a35-7c09-4788-862e-506a1e81cb37 of volume 7a1463fc-8866-4057-8b10-2bb5bcc2c4a1 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:08:52 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-ec670ebc-c02e-42d3-97eb-74197ce094e7 tempest-GroupsV314Test-1306254640 None] Group tempest-GroupsV314Test-Group-52453031: created successfully Apr 27 10:08:52 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-ec670ebc-c02e-42d3-97eb-74197ce094e7 tempest-GroupsV314Test-1306254640 None] Create group completed successfully. Apr 27 10:08:52 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc392d8-a6b1-42f7-95a4-2b54df4308a3]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cca46c9b-512c-403d-ad91-eee43def228c tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:52 devstack sudo[85925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1 Apr 27 10:08:52 devstack sudo[85925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:53 devstack sudo[85925]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cca46c9b-512c-403d-ad91-eee43def228c tempest-VolumesSnapshotNegativeTestJSON-654386620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1" returned: 0 in 0.716s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cca46c9b-512c-403d-ad91-eee43def228c tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.2b909a35-7c09-4788-862e-506a1e81cb37 2G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:53 devstack sudo[85930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.2b909a35-7c09-4788-862e-506a1e81cb37 2G Apr 27 10:08:53 devstack sudo[85930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:53 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:08:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Flow 'volume_create_manager' (3c5f28b1-7f2d-4204-8491-ebdb2380b522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:08:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1347b70-024d-471b-9909-113cf81d1322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1347b70-024d-471b-9909-113cf81d1322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1681250497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c5f202d5-60ad-44b6-b03a-b15deb8ffaad,host='devstack@QuobyteHD#QuobyteHD',id=cf2cadd0-92fd-4346-ac11-732846c13171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092f69395e4e4dc984bc6b896b6f36ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:08:54Z,use_quota=True,user_id='e9899550c3b24a8ea9f03388c6ed34e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e43b692-e57b-4343-9527-4013b8190bf7),volume_type_id=0e43b692-e57b-4343-9527-4013b8190bf7)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e756085a-04a4-4ce8-9bf6-d3185ed94b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e756085a-04a4-4ce8-9bf6-d3185ed94b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b604432-8292-44c3-bd51-872b0c8691f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b604432-8292-44c3-bd51-872b0c8691f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf2cadd0-92fd-4346-ac11-732846c13171', 'volume_name': 'volume-cf2cadd0-92fd-4346-ac11-732846c13171', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f32c0c0b-9fbf-4ee6-bc24-12fbed96d316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f32c0c0b-9fbf-4ee6-bc24-12fbed96d316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9400855-b87d-4ff4-b1dc-8990bb64e401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:54 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Volume cf2cadd0-92fd-4346-ac11-732846c13171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf2cadd0-92fd-4346-ac11-732846c13171', 'volume_size': 1} Apr 27 10:08:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:54 devstack sudo[85930]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cca46c9b-512c-403d-ad91-eee43def228c tempest-VolumesSnapshotNegativeTestJSON-654386620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.2b909a35-7c09-4788-862e-506a1e81cb37 2G" returned: 0 in 1.178s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cca46c9b-512c-403d-ad91-eee43def228c tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.2b909a35-7c09-4788-862e-506a1e81cb37 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:54 devstack sudo[85970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.2b909a35-7c09-4788-862e-506a1e81cb37 Apr 27 10:08:54 devstack sudo[85970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:54 devstack sudo[85970]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cca46c9b-512c-403d-ad91-eee43def228c tempest-VolumesSnapshotNegativeTestJSON-654386620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.2b909a35-7c09-4788-862e-506a1e81cb37" returned: 0 in 0.611s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:54 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-cca46c9b-512c-403d-ad91-eee43def228c tempest-VolumesSnapshotNegativeTestJSON-654386620 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.2b909a35-7c09-4788-862e-506a1e81cb37 is being set with open permissions: ugo+rw Apr 27 10:08:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cca46c9b-512c-403d-ad91-eee43def228c tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.2b909a35-7c09-4788-862e-506a1e81cb37 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:54 devstack sudo[85976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.2b909a35-7c09-4788-862e-506a1e81cb37 Apr 27 10:08:54 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:55 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cca46c9b-512c-403d-ad91-eee43def228c tempest-VolumesSnapshotNegativeTestJSON-654386620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.2b909a35-7c09-4788-862e-506a1e81cb37" returned: 0 in 0.604s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cca46c9b-512c-403d-ad91-eee43def228c tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:55 devstack sudo[85979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.info Apr 27 10:08:55 devstack sudo[85979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:56 devstack sudo[85979]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cca46c9b-512c-403d-ad91-eee43def228c tempest-VolumesSnapshotNegativeTestJSON-654386620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.info" returned: 0 in 0.631s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:56 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-cca46c9b-512c-403d-ad91-eee43def228c tempest-VolumesSnapshotNegativeTestJSON-654386620 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.info is being set with open permissions: ugo+rw Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cca46c9b-512c-403d-ad91-eee43def228c tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:56 devstack sudo[85982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.info Apr 27 10:08:56 devstack sudo[85982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:56 devstack sudo[85982]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Flow 'volume_create_manager' (7fdbba02-6ee8-4c2b-b71b-cc8d38c66632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4317479-9080-4ad7-9c07-688ec85f3337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cca46c9b-512c-403d-ad91-eee43def228c tempest-VolumesSnapshotNegativeTestJSON-654386620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.info" returned: 0 in 0.667s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-cca46c9b-512c-403d-ad91-eee43def228c tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.543s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.624s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c5f202d5-60ad-44b6-b03a-b15deb8ffaad,created_at=2026-04-27T08:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1681250497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c5f202d5-60ad-44b6-b03a-b15deb8ffaad,host='devstack@QuobyteHD#QuobyteHD',id=cf2cadd0-92fd-4346-ac11-732846c13171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092f69395e4e4dc984bc6b896b6f36ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:08:54Z,use_quota=True,user_id='e9899550c3b24a8ea9f03388c6ed34e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e43b692-e57b-4343-9527-4013b8190bf7),volume_type_id=0e43b692-e57b-4343-9527-4013b8190bf7)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Creating volume cf2cadd0-92fd-4346-ac11-732846c13171 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:08:56 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:56 devstack sudo[85985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171 1073741824 Apr 27 10:08:56 devstack sudo[85985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4317479-9080-4ad7-9c07-688ec85f3337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-291929212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b7daeb-5dd1-40f5-ba81-36b302279142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be54d6a1b6304f429cc8977de7959053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:08:57Z,use_quota=True,user_id='4762c5ff9c794bf0ad2107a154abb5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49efbf3c-00f4-4d06-bf23-7d9281c379b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49efbf3c-00f4-4d06-bf23-7d9281c379b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb27b4d-7336-495a-aa41-f1b914dd36b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb27b4d-7336-495a-aa41-f1b914dd36b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01b7daeb-5dd1-40f5-ba81-36b302279142', 'volume_name': 'volume-01b7daeb-5dd1-40f5-ba81-36b302279142', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6685bea-bb2d-4b37-874d-77558268972c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6685bea-bb2d-4b37-874d-77558268972c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc4407b-c730-4c92-89f6-ec8fa27b5136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:56 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Volume 01b7daeb-5dd1-40f5-ba81-36b302279142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01b7daeb-5dd1-40f5-ba81-36b302279142', 'volume_size': 1} Apr 27 10:08:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:56 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-cca46c9b-512c-403d-ad91-eee43def228c tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Create snapshot completed successfully Apr 27 10:08:57 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-36f575c8-0224-4a84-bd32-c537859d0e09 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Acquiring lock "cinder-2b909a35-7c09-4788-862e-506a1e81cb37-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:57 devstack sudo[85985]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171 1073741824" returned: 0 in 0.701s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:57 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-36f575c8-0224-4a84-bd32-c537859d0e09 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Lock "cinder-2b909a35-7c09-4788-862e-506a1e81cb37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:57 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-36f575c8-0224-4a84-bd32-c537859d0e09 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Acquiring lock "cinder-quobyte-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:57 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-36f575c8-0224-4a84-bd32-c537859d0e09 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Lock "cinder-quobyte-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:57 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-36f575c8-0224-4a84-bd32-c537859d0e09 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Acquiring lock "cinder-quobyte-2b909a35-7c09-4788-862e-506a1e81cb37" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:08:57 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-36f575c8-0224-4a84-bd32-c537859d0e09 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Lock "cinder-quobyte-2b909a35-7c09-4788-862e-506a1e81cb37" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:08:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-36f575c8-0224-4a84-bd32-c537859d0e09 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Deleting offline snapshot 2b909a35-7c09-4788-862e-506a1e81cb37 of volume 7a1463fc-8866-4057-8b10-2bb5bcc2c4a1 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:08:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-36f575c8-0224-4a84-bd32-c537859d0e09 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] snapshot_file for this snap is: volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.2b909a35-7c09-4788-862e-506a1e81cb37 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:08:57 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b196b97-8df1-4628-b9a6-3e02270f8980]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-36f575c8-0224-4a84-bd32-c537859d0e09 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.2b909a35-7c09-4788-862e-506a1e81cb37 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:57 devstack sudo[85998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171 Apr 27 10:08:57 devstack sudo[85998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:57 devstack sudo[85997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.2b909a35-7c09-4788-862e-506a1e81cb37 Apr 27 10:08:57 devstack sudo[85997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:58 devstack sudo[85998]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171" returned: 0 in 0.568s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:58 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:08:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.320s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:58 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-291929212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b7daeb-5dd1-40f5-ba81-36b302279142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be54d6a1b6304f429cc8977de7959053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:08:57Z,use_quota=True,user_id='4762c5ff9c794bf0ad2107a154abb5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:08:58 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Creating volume 01b7daeb-5dd1-40f5-ba81-36b302279142 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:08:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:08:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:08:58 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:08:58 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:08:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:08:58 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:08:58 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:08:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:58 devstack sudo[85997]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-36f575c8-0224-4a84-bd32-c537859d0e09 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.2b909a35-7c09-4788-862e-506a1e81cb37" returned: 0 in 0.617s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:58 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-36f575c8-0224-4a84-bd32-c537859d0e09 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:08:58 devstack sudo[86020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142 1073741824 Apr 27 10:08:58 devstack sudo[86020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9400855-b87d-4ff4-b1dc-8990bb64e401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf2cadd0-92fd-4346-ac11-732846c13171', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffbe9736-d08b-4eeb-983a-1fa3167eb0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:08:58 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c714d3b-12d5-49e6-ba3c-e91f4feb0048]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:08:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-36f575c8-0224-4a84-bd32-c537859d0e09 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:58 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Volume volume-cf2cadd0-92fd-4346-ac11-732846c13171 (cf2cadd0-92fd-4346-ac11-732846c13171): created successfully Apr 27 10:08:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffbe9736-d08b-4eeb-983a-1fa3167eb0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:08:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Flow 'volume_create_manager' (3c5f28b1-7f2d-4204-8491-ebdb2380b522) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:08:58 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-bb4b7d33-78e8-49b1-a388-c7b943aaf171 tempest-GroupsV314Test-1306254640 None] Created volume successfully. Apr 27 10:08:58 devstack sudo[86022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1 Apr 27 10:08:58 devstack sudo[86022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:59 devstack sudo[86022]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-36f575c8-0224-4a84-bd32-c537859d0e09 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1" returned: 0 in 0.739s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-36f575c8-0224-4a84-bd32-c537859d0e09 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.2b909a35-7c09-4788-862e-506a1e81cb37 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:59 devstack sudo[86036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.2b909a35-7c09-4788-862e-506a1e81cb37 Apr 27 10:08:59 devstack sudo[86036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:59 devstack sudo[86020]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142 1073741824" returned: 0 in 0.882s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:59 devstack sudo[86038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142 Apr 27 10:08:59 devstack sudo[86038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:59 devstack sudo[86036]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-36f575c8-0224-4a84-bd32-c537859d0e09 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.2b909a35-7c09-4788-862e-506a1e81cb37" returned: 0 in 0.653s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-36f575c8-0224-4a84-bd32-c537859d0e09 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.2b909a35-7c09-4788-862e-506a1e81cb37 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:08:59 devstack sudo[86044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.2b909a35-7c09-4788-862e-506a1e81cb37 Apr 27 10:08:59 devstack sudo[86044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:08:59 devstack sudo[86038]: pam_unix(sudo:session): session closed for user root Apr 27 10:08:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142" returned: 0 in 0.755s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:08:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:08:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc4407b-c730-4c92-89f6-ec8fa27b5136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01b7daeb-5dd1-40f5-ba81-36b302279142', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e14e43-9836-4ec2-8533-67b274713083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:00 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Volume volume-01b7daeb-5dd1-40f5-ba81-36b302279142 (01b7daeb-5dd1-40f5-ba81-36b302279142): created successfully Apr 27 10:09:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e14e43-9836-4ec2-8533-67b274713083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Flow 'volume_create_manager' (7fdbba02-6ee8-4c2b-b71b-cc8d38c66632) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:09:00 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-436fb573-8394-4f11-948b-ade1f59c48ea tempest-SnapshotsActionsTest-1847495719 None] Created volume successfully. Apr 27 10:09:00 devstack sudo[86044]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-36f575c8-0224-4a84-bd32-c537859d0e09 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1.2b909a35-7c09-4788-862e-506a1e81cb37" returned: 0 in 0.693s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-36f575c8-0224-4a84-bd32-c537859d0e09 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Lock "cinder-quobyte-2b909a35-7c09-4788-862e-506a1e81cb37" released by "_delete_snapshot" :: held 2.905s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-36f575c8-0224-4a84-bd32-c537859d0e09 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Lock "cinder-quobyte-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1" released by "delete_snapshot" :: held 2.937s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:00 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-36f575c8-0224-4a84-bd32-c537859d0e09 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Created reservations ['f8a28bb3-ab7d-483f-82e4-164d1153e491', '10d1c449-30d5-4e84-9720-d7d75be46892', '1b640158-7331-4407-bb89-a845c54a3e20', '84fe0982-9040-47a9-9c07-3ec54b864f53'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:09:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:00 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Cloning volume cf2cadd0-92fd-4346-ac11-732846c13171 to volume fdc0b043-e33c-4153-a825-d15ca7c1256f Apr 27 10:09:01 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-36f575c8-0224-4a84-bd32-c537859d0e09 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Delete snapshot completed successfully. Apr 27 10:09:01 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-94468f0c-4110-4444-ac31-5507762cbdcd tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Acquiring lock "cinder-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:01 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-36f575c8-0224-4a84-bd32-c537859d0e09 tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Lock "cinder-2b909a35-7c09-4788-862e-506a1e81cb37-delete_snapshot" released by "delete_snapshot" :: held 3.441s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Creating offline snapshot 5d80d0f4-893a-4353-b7ec-6ed9a9675506 of volume cf2cadd0-92fd-4346-ac11-732846c13171 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:09:01 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-94468f0c-4110-4444-ac31-5507762cbdcd tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Lock "cinder-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:01 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a37e89e-e060-4ca9-9613-3ccc51f1d9e6]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:01 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-94468f0c-4110-4444-ac31-5507762cbdcd tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Acquiring lock "cinder-quobyte-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:01 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-94468f0c-4110-4444-ac31-5507762cbdcd tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Lock "cinder-quobyte-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1" acquired by "delete_volume" :: waited 0.015s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:01 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41e808f-1645-4b97-96cf-464656fec1cb]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-94468f0c-4110-4444-ac31-5507762cbdcd tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:01 devstack sudo[86048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171 Apr 27 10:09:01 devstack sudo[86048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:01 devstack sudo[86049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1 Apr 27 10:09:01 devstack sudo[86049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-df499d8d-14de-4536-b48f-d502137f8d20 tempest-SnapshotsActionsTest-1847495719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:02 devstack sudo[86048]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171" returned: 0 in 1.106s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.5d80d0f4-893a-4353-b7ec-6ed9a9675506 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:02 devstack sudo[86098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.5d80d0f4-893a-4353-b7ec-6ed9a9675506 1G Apr 27 10:09:02 devstack sudo[86098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:02 devstack sudo[86049]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-94468f0c-4110-4444-ac31-5507762cbdcd tempest-VolumesSnapshotNegativeTestJSON-654386620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1" returned: 0 in 1.088s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-94468f0c-4110-4444-ac31-5507762cbdcd tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:02 devstack sudo[86100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1 Apr 27 10:09:02 devstack sudo[86100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:02 devstack sudo[86100]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-94468f0c-4110-4444-ac31-5507762cbdcd tempest-VolumesSnapshotNegativeTestJSON-654386620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1" returned: 0 in 0.500s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:02 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-94468f0c-4110-4444-ac31-5507762cbdcd tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Lock "cinder-quobyte-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1" released by "delete_volume" :: held 1.655s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:02 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-94468f0c-4110-4444-ac31-5507762cbdcd tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Created reservations ['ae28c310-9456-4c2b-b23d-1c7f85a4089e', 'ba9ed9f9-0274-4186-ba13-2e0ffc41e40c', 'c5de7aed-3cc4-4b85-a7cb-9b39856dacf2', '4aa9c939-c89f-4741-a4d5-e2fd9111e742'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:09:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-94468f0c-4110-4444-ac31-5507762cbdcd tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-94468f0c-4110-4444-ac31-5507762cbdcd tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-94468f0c-4110-4444-ac31-5507762cbdcd tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:09:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-94468f0c-4110-4444-ac31-5507762cbdcd tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:09:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-94468f0c-4110-4444-ac31-5507762cbdcd tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-94468f0c-4110-4444-ac31-5507762cbdcd tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:03 devstack sudo[86098]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.5d80d0f4-893a-4353-b7ec-6ed9a9675506 1G" returned: 0 in 0.772s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2cadd0-92fd-4346-ac11-732846c13171 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.5d80d0f4-893a-4353-b7ec-6ed9a9675506 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:03 devstack sudo[86106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:09:03 devstack sudo[86106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:03 devstack sudo[86107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2cadd0-92fd-4346-ac11-732846c13171 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.5d80d0f4-893a-4353-b7ec-6ed9a9675506 Apr 27 10:09:03 devstack sudo[86107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:03 devstack sudo[86106]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-94468f0c-4110-4444-ac31-5507762cbdcd tempest-VolumesSnapshotNegativeTestJSON-654386620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.611s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:03 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-94468f0c-4110-4444-ac31-5507762cbdcd tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:09:03 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-94468f0c-4110-4444-ac31-5507762cbdcd tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Deleted volume successfully. Apr 27 10:09:03 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-94468f0c-4110-4444-ac31-5507762cbdcd tempest-VolumesSnapshotNegativeTestJSON-654386620 None] Lock "cinder-7a1463fc-8866-4057-8b10-2bb5bcc2c4a1-delete_volume" released by "delete_volume" :: held 2.546s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:03 devstack sudo[86107]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2cadd0-92fd-4346-ac11-732846c13171 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.5d80d0f4-893a-4353-b7ec-6ed9a9675506" returned: 0 in 0.707s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:03 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.5d80d0f4-893a-4353-b7ec-6ed9a9675506 is being set with open permissions: ugo+rw: NotImplementedError Apr 27 10:09:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.5d80d0f4-893a-4353-b7ec-6ed9a9675506 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:03 devstack sudo[86115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.5d80d0f4-893a-4353-b7ec-6ed9a9675506 Apr 27 10:09:03 devstack sudo[86115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:04 devstack sudo[86115]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.5d80d0f4-893a-4353-b7ec-6ed9a9675506" returned: 0 in 0.623s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:04 devstack sudo[86121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.info Apr 27 10:09:04 devstack sudo[86121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:04 devstack sudo[86121]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.info" returned: 0 in 0.542s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:04 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.info is being set with open permissions: ugo+rw: NotImplementedError Apr 27 10:09:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:04 devstack sudo[86132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.info Apr 27 10:09:04 devstack sudo[86132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:05 devstack sudo[86132]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.info" returned: 0 in 0.666s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:05 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Acquiring lock "cinder-quobyte-fdc0b043-e33c-4153-a825-d15ca7c1256f" by "_copy_volume_from_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:05 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Lock "cinder-quobyte-fdc0b043-e33c-4153-a825-d15ca7c1256f" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:05 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] snapshot: 5d80d0f4-893a-4353-b7ec-6ed9a9675506, volume: fdc0b043-e33c-4153-a825-d15ca7c1256f, {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 27 10:09:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:05 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:09:05 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:09:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:05 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e224574b-6b83-4ee4-b50b-7084e1cf7078]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.5d80d0f4-893a-4353-b7ec-6ed9a9675506 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:05 devstack sudo[86142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.5d80d0f4-893a-4353-b7ec-6ed9a9675506 Apr 27 10:09:05 devstack sudo[86142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:06 devstack sudo[86142]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.5d80d0f4-893a-4353-b7ec-6ed9a9675506" returned: 0 in 0.641s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:06 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf2cadd0-92fd-4346-ac11-732846c13171(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:09:06 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171 {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 27 10:09:06 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Creating direct copy from snapshot {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 27 10:09:06 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebe95f2-70de-43ae-8d35-75c197ff089e]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:06 devstack sudo[86147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171 Apr 27 10:09:06 devstack sudo[86147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:06 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:09:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Flow 'volume_create_manager' (22763975-c723-4e7c-bd3f-94656c3b16cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:09:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644f39a1-39d9-466b-8aa5-2783e131051f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644f39a1-39d9-466b-8aa5-2783e131051f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-153977869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7284f2c4-8e03-4e5a-8580-7cfa3a503df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='657a81319c3d444b8338f14a460cb651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:09:07Z,use_quota=True,user_id='945a78b202af46549091d37cb6b4e418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf6804ae-30cb-4ae9-ac71-8adff0d42340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf6804ae-30cb-4ae9-ac71-8adff0d42340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e920a5f-b26b-4d93-b648-3a872622464b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e920a5f-b26b-4d93-b648-3a872622464b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7284f2c4-8e03-4e5a-8580-7cfa3a503df9', 'volume_name': 'volume-7284f2c4-8e03-4e5a-8580-7cfa3a503df9', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24eb3790-d2d2-4dff-9539-5562535a2b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24eb3790-d2d2-4dff-9539-5562535a2b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a03f07-60d0-441d-86e3-a4eb0fdb4cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:06 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Volume 7284f2c4-8e03-4e5a-8580-7cfa3a503df9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7284f2c4-8e03-4e5a-8580-7cfa3a503df9', 'volume_size': 1} Apr 27 10:09:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:06 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:09:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Flow 'volume_create_manager' (6c2b98b8-91cc-47a4-85fe-a97bc4de4a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:09:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abe8a46-f4be-4a0f-b16c-074adefee243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abe8a46-f4be-4a0f-b16c-074adefee243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1633280857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cd63c6-05d5-4694-8765-8696d89c6d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='657a81319c3d444b8338f14a460cb651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:09:07Z,use_quota=True,user_id='945a78b202af46549091d37cb6b4e418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc0b55d-77db-44ff-82cd-49e297bde361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc0b55d-77db-44ff-82cd-49e297bde361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff55ebe-2e6a-4138-962b-99a7075c22a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:07 devstack sudo[86147]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff55ebe-2e6a-4138-962b-99a7075c22a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62cd63c6-05d5-4694-8765-8696d89c6d2b', 'volume_name': 'volume-62cd63c6-05d5-4694-8765-8696d89c6d2b', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6459a94-ccf8-4bbf-bf4f-eba8e710884e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6459a94-ccf8-4bbf-bf4f-eba8e710884e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678f8487-bd38-48e8-94f8-020ae57f2525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:07 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Volume 62cd63c6-05d5-4694-8765-8696d89c6d2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62cd63c6-05d5-4694-8765-8696d89c6d2b', 'volume_size': 1} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171" returned: 0 in 0.698s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.utils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Path /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-fdc0b043-e33c-4153-a825-d15ca7c1256f not found in is_blk_device check {{(pid=81350) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-fdc0b043-e33c-4153-a825-d15ca7c1256f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:07 devstack sudo[86152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-fdc0b043-e33c-4153-a825-d15ca7c1256f Apr 27 10:09:07 devstack sudo[86152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Flow 'volume_create_manager' (2384bf90-b247-4331-a57a-ace0a28854df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd20c75-6d3e-42f3-857b-ef945d2b9ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd20c75-6d3e-42f3-857b-ef945d2b9ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-171287879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf38311-1bea-4b13-8826-3b6478cfb311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='657a81319c3d444b8338f14a460cb651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:09:07Z,use_quota=True,user_id='945a78b202af46549091d37cb6b4e418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (992a6707-35e2-40dc-a742-267a0bc1a60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (992a6707-35e2-40dc-a742-267a0bc1a60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6e85fd-ba37-4b66-898b-8cc3ddf92ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6e85fd-ba37-4b66-898b-8cc3ddf92ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abf38311-1bea-4b13-8826-3b6478cfb311', 'volume_name': 'volume-abf38311-1bea-4b13-8826-3b6478cfb311', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83ef6d2-17a2-4b8f-aad1-469cccfe6d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83ef6d2-17a2-4b8f-aad1-469cccfe6d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a677efcb-f4b3-436a-9fc5-ef8cccb6b9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:07 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Volume abf38311-1bea-4b13-8826-3b6478cfb311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abf38311-1bea-4b13-8826-3b6478cfb311', 'volume_size': 1} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Flow 'volume_create_manager' (f0793da8-33fc-4d5b-8ecf-f951d36819a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f55989c7-a4de-4f75-8ee9-f89c984d4c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f55989c7-a4de-4f75-8ee9-f89c984d4c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-938141010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9858f4a-896f-4f4d-a182-38a26de798e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='657a81319c3d444b8338f14a460cb651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:09:08Z,use_quota=True,user_id='945a78b202af46549091d37cb6b4e418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a343208-b9fb-4c07-950f-d31bbc56e61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a343208-b9fb-4c07-950f-d31bbc56e61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54a987a8-068e-49be-9a8e-396038daacaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54a987a8-068e-49be-9a8e-396038daacaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9858f4a-896f-4f4d-a182-38a26de798e3', 'volume_name': 'volume-d9858f4a-896f-4f4d-a182-38a26de798e3', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (181936c2-9296-4cdb-8753-617219d40e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (181936c2-9296-4cdb-8753-617219d40e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d47094d-9057-481e-a0da-1dfbb7df1b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:07 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Volume d9858f4a-896f-4f4d-a182-38a26de798e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9858f4a-896f-4f4d-a182-38a26de798e3', 'volume_size': 1} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Flow 'volume_create_manager' (2fa746d3-a785-483b-872d-6ec601682840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5cf426-230f-4451-9a59-9a11c41e463d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5cf426-230f-4451-9a59-9a11c41e463d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2140723313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c013ef7-db61-48f7-a0fa-f1be8d18f0b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='657a81319c3d444b8338f14a460cb651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:09:08Z,use_quota=True,user_id='945a78b202af46549091d37cb6b4e418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404d4f18-1242-4d23-93c1-e771225fa27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404d4f18-1242-4d23-93c1-e771225fa27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d508ff-6415-4d5c-8932-97b5e37795b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d508ff-6415-4d5c-8932-97b5e37795b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c013ef7-db61-48f7-a0fa-f1be8d18f0b4', 'volume_name': 'volume-3c013ef7-db61-48f7-a0fa-f1be8d18f0b4', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eba8e35-730f-456d-b277-3d4b14ab4084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eba8e35-730f-456d-b277-3d4b14ab4084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7377815c-a6e6-4734-ba05-115982505c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:08 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Volume 3c013ef7-db61-48f7-a0fa-f1be8d18f0b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c013ef7-db61-48f7-a0fa-f1be8d18f0b4', 'volume_size': 1} Apr 27 10:09:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:11 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:09:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Flow 'volume_create_manager' (27d1df0b-ac26-4382-9f60-eff26b85f791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:09:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e5b874-9e39-46fb-84ea-30481455296f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:12 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:SELECT=115,cinder:INSERT=31,cinder:UPDATE=125,cinder:DELETE=8 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:09:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e5b874-9e39-46fb-84ea-30481455296f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:09:11Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7745614c785f4446ae5e26e4ac4b0644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:09:12Z,use_quota=True,user_id='0ff7d28488cd45a3924a8cc6ed95a14e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329d3e29-109d-420e-8574-c6fa87586625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329d3e29-109d-420e-8574-c6fa87586625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e91929-363d-43cd-90a7-c749be6eaea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:12 devstack cinder-volume[81350]: DEBUG cinder.image.glance [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Creating Keystone auth plugin from conf {{(pid=81350) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 27 10:09:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e91929-363d-43cd-90a7-c749be6eaea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2', 'volume_name': 'volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2', 'volume_size': 1, 'image_id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f81a6757fcfa47c099a3bbded3b529cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'created_at': datetime.datetime(2026, 4, 27, 7, 59, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 7, 59, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb986c3-e61f-4956-aa3d-1af877619c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb986c3-e61f-4956-aa3d-1af877619c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b42c7744-3792-4859-aac9-f6f5ee1e0304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:12 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Volume b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2', 'volume_size': 1, 'image_id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f81a6757fcfa47c099a3bbded3b529cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'created_at': datetime.datetime(2026, 4, 27, 7, 59, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 7, 59, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 27 10:09:12 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Trying to clone b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 from image d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa at location (None, [{'url': 'file:///opt/stack/data/glance/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'metadata': {}}]). {{(pid=81350) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 27 10:09:13 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_d5kpq_dqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81350) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 27 10:09:13 devstack cinder-volume[81350]: INFO cinder.image.image_utils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Image download 20.69 MB at 20.69 MB/s Apr 27 10:09:13 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[01965f04-4381-4c37-9e5e-22c3d8d85a2c]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_d5kpq_dqdevstack@QuobyteHD {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:13 devstack sudo[86187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_d5kpq_dqdevstack@QuobyteHD Apr 27 10:09:13 devstack sudo[86187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:13 devstack sudo[86152]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-fdc0b043-e33c-4153-a825-d15ca7c1256f" returned: 0 in 6.820s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:13 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c17c47-dd5d-4901-a6e0-7e538d1c34ff]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:13 devstack sudo[86189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171 Apr 27 10:09:13 devstack sudo[86189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:14 devstack sudo[86187]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_d5kpq_dqdevstack@QuobyteHD" returned: 0 in 0.564s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:14 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Temporary image d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa is fetched for user 0ff7d28488cd45a3924a8cc6ed95a14e. {{(pid=81350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 27 10:09:14 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:UPDATE=125,cinder:SELECT=107,cinder:INSERT=31,cinder:DELETE=9 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:09:14 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6238d68e-3f39-4039-ab16-e0f6c542f099]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_d5kpq_dqdevstack@QuobyteHD {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:14 devstack sudo[86195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_d5kpq_dqdevstack@QuobyteHD Apr 27 10:09:14 devstack sudo[86195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:14 devstack sudo[86189]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171" returned: 0 in 0.659s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:14 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Image conversion details: src /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171, size 1024.00 MB, duration 6.82 sec, destination /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-fdc0b043-e33c-4153-a825-d15ca7c1256f {{(pid=81350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 10:09:14 devstack cinder-volume[81350]: INFO cinder.image.image_utils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Converted 1024.00 MB image at 150.09 MB/s Apr 27 10:09:14 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-fdc0b043-e33c-4153-a825-d15ca7c1256f is being set with open permissions: ugo+rw: NotImplementedError Apr 27 10:09:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-fdc0b043-e33c-4153-a825-d15ca7c1256f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:14 devstack sudo[86200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-fdc0b043-e33c-4153-a825-d15ca7c1256f Apr 27 10:09:14 devstack sudo[86200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:14 devstack sudo[86195]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_d5kpq_dqdevstack@QuobyteHD" returned: 0 in 0.563s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:15 devstack sudo[86200]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-fdc0b043-e33c-4153-a825-d15ca7c1256f" returned: 0 in 0.500s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:15 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Lock "cinder-quobyte-fdc0b043-e33c-4153-a825-d15ca7c1256f" released by "_copy_volume_from_snapshot" :: held 9.416s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:15 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Acquiring lock "cinder-quobyte-5d80d0f4-893a-4353-b7ec-6ed9a9675506" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:15 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Lock "cinder-quobyte-5d80d0f4-893a-4353-b7ec-6ed9a9675506" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:15 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Deleting offline snapshot 5d80d0f4-893a-4353-b7ec-6ed9a9675506 of volume cf2cadd0-92fd-4346-ac11-732846c13171 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:09:15 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] snapshot_file for this snap is: volume-cf2cadd0-92fd-4346-ac11-732846c13171.5d80d0f4-893a-4353-b7ec-6ed9a9675506 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:09:15 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[961c8d3f-db9f-4171-9dad-3289166e0d58]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.5d80d0f4-893a-4353-b7ec-6ed9a9675506 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:15 devstack sudo[86212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.5d80d0f4-893a-4353-b7ec-6ed9a9675506 Apr 27 10:09:15 devstack sudo[86212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:15 devstack sudo[86212]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.5d80d0f4-893a-4353-b7ec-6ed9a9675506" returned: 0 in 0.563s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:15 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf2cadd0-92fd-4346-ac11-732846c13171(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:09:15 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0086f6-54cc-4543-8e1d-4a35479d3185]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:15 devstack sudo[86217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171 Apr 27 10:09:15 devstack sudo[86217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:16 devstack sudo[86217]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171" returned: 0 in 0.569s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.5d80d0f4-893a-4353-b7ec-6ed9a9675506 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:16 devstack sudo[86222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.5d80d0f4-893a-4353-b7ec-6ed9a9675506 Apr 27 10:09:16 devstack sudo[86222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:16 devstack cinder-volume[81350]: DEBUG oslo_service.periodic_task [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81350) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 10:09:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:09:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:09:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:16 devstack sudo[86226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:09:16 devstack sudo[86226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:16 devstack sudo[86222]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.5d80d0f4-893a-4353-b7ec-6ed9a9675506" returned: 0 in 0.537s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.5d80d0f4-893a-4353-b7ec-6ed9a9675506 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:16 devstack sudo[86229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.5d80d0f4-893a-4353-b7ec-6ed9a9675506 Apr 27 10:09:16 devstack sudo[86229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:17 devstack sudo[86226]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.464s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:17 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:09:17 devstack sudo[86229]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171.5d80d0f4-893a-4353-b7ec-6ed9a9675506" returned: 0 in 0.475s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:17 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Lock "cinder-quobyte-5d80d0f4-893a-4353-b7ec-6ed9a9675506" released by "_delete_snapshot" :: held 2.239s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.384s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-df499d8d-14de-4536-b48f-d502137f8d20 tempest-SnapshotsActionsTest-1847495719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.747s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:17 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-df499d8d-14de-4536-b48f-d502137f8d20 tempest-SnapshotsActionsTest-1847495719 None] Creating offline snapshot 5305d55c-b50a-460a-bbe0-cfc4b478c82b of volume 01b7daeb-5dd1-40f5-ba81-36b302279142 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:09:17 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9a88e7-8bce-48d0-8645-31cb78b50d1b]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df499d8d-14de-4536-b48f-d502137f8d20 tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:17 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-39d63642-cd5a-4924-9727-a2f080b02313 tempest-GroupsV314Test-1306254640 None] Create group from source-group-c5f202d5-60ad-44b6-b03a-b15deb8ffaad completed successfully. Apr 27 10:09:17 devstack sudo[86233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142 Apr 27 10:09:17 devstack sudo[86233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:17 devstack sudo[86233]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df499d8d-14de-4536-b48f-d502137f8d20 tempest-SnapshotsActionsTest-1847495719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142" returned: 0 in 0.521s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df499d8d-14de-4536-b48f-d502137f8d20 tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:17 devstack sudo[86238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b 1G Apr 27 10:09:17 devstack sudo[86238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:18 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-24ef439a-7a2a-4169-89c9-263faf1b8895 tempest-GroupsV314Test-1306254640 None] Acquiring lock "cinder-quobyte-fdc0b043-e33c-4153-a825-d15ca7c1256f" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:18 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-24ef439a-7a2a-4169-89c9-263faf1b8895 tempest-GroupsV314Test-1306254640 None] Lock "cinder-quobyte-fdc0b043-e33c-4153-a825-d15ca7c1256f" acquired by "delete_volume" :: waited 0.020s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:18 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[440b7902-6265-48ed-b4a4-304c2582596f]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-24ef439a-7a2a-4169-89c9-263faf1b8895 tempest-GroupsV314Test-1306254640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-fdc0b043-e33c-4153-a825-d15ca7c1256f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:18 devstack sudo[86238]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df499d8d-14de-4536-b48f-d502137f8d20 tempest-SnapshotsActionsTest-1847495719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b 1G" returned: 0 in 0.663s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df499d8d-14de-4536-b48f-d502137f8d20 tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b7daeb-5dd1-40f5-ba81-36b302279142 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:18 devstack sudo[86243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-fdc0b043-e33c-4153-a825-d15ca7c1256f Apr 27 10:09:18 devstack sudo[86243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:18 devstack sudo[86245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b7daeb-5dd1-40f5-ba81-36b302279142 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b Apr 27 10:09:18 devstack sudo[86245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:19 devstack sudo[86243]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-24ef439a-7a2a-4169-89c9-263faf1b8895 tempest-GroupsV314Test-1306254640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-fdc0b043-e33c-4153-a825-d15ca7c1256f" returned: 0 in 0.552s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-24ef439a-7a2a-4169-89c9-263faf1b8895 tempest-GroupsV314Test-1306254640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-fdc0b043-e33c-4153-a825-d15ca7c1256f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:19 devstack sudo[86253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-fdc0b043-e33c-4153-a825-d15ca7c1256f Apr 27 10:09:19 devstack sudo[86253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:19 devstack sudo[86245]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df499d8d-14de-4536-b48f-d502137f8d20 tempest-SnapshotsActionsTest-1847495719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b7daeb-5dd1-40f5-ba81-36b302279142 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b" returned: 0 in 0.518s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:19 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-df499d8d-14de-4536-b48f-d502137f8d20 tempest-SnapshotsActionsTest-1847495719 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b is being set with open permissions: ugo+rw Apr 27 10:09:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df499d8d-14de-4536-b48f-d502137f8d20 tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:19 devstack sudo[86255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b Apr 27 10:09:19 devstack sudo[86255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:19 devstack sudo[86253]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-24ef439a-7a2a-4169-89c9-263faf1b8895 tempest-GroupsV314Test-1306254640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-fdc0b043-e33c-4153-a825-d15ca7c1256f" returned: 0 in 0.498s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:19 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-24ef439a-7a2a-4169-89c9-263faf1b8895 tempest-GroupsV314Test-1306254640 None] Lock "cinder-quobyte-fdc0b043-e33c-4153-a825-d15ca7c1256f" released by "delete_volume" :: held 1.091s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:19 devstack sudo[86255]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df499d8d-14de-4536-b48f-d502137f8d20 tempest-SnapshotsActionsTest-1847495719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b" returned: 0 in 0.470s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df499d8d-14de-4536-b48f-d502137f8d20 tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:19 devstack sudo[86259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.info Apr 27 10:09:19 devstack sudo[86259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:19 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-24ef439a-7a2a-4169-89c9-263faf1b8895 tempest-GroupsV314Test-1306254640 None] Created reservations ['9ce0066d-6b3e-4f55-9bfb-5e40996d210e'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:09:19 devstack cinder-volume[81350]: WARNING cinder.quota [None req-24ef439a-7a2a-4169-89c9-263faf1b8895 tempest-GroupsV314Test-1306254640 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-27633485 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-27633485, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:09:19 devstack cinder-volume[81350]: WARNING cinder.quota [None req-24ef439a-7a2a-4169-89c9-263faf1b8895 tempest-GroupsV314Test-1306254640 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-27633485 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-27633485, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:09:19 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-24ef439a-7a2a-4169-89c9-263faf1b8895 tempest-GroupsV314Test-1306254640 None] Created reservations ['dccaa657-2acc-4d3b-a38c-54ac2fa7d898', 'd478e369-2eda-4dac-9c4f-6b85328d4eb3', '3d32e58b-3227-4ee6-af73-14c353cd17fc', '709e1e04-0c50-408e-a3ba-15b812523bb7'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:09:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-24ef439a-7a2a-4169-89c9-263faf1b8895 tempest-GroupsV314Test-1306254640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-24ef439a-7a2a-4169-89c9-263faf1b8895 tempest-GroupsV314Test-1306254640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:19 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-24ef439a-7a2a-4169-89c9-263faf1b8895 tempest-GroupsV314Test-1306254640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:09:19 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-24ef439a-7a2a-4169-89c9-263faf1b8895 tempest-GroupsV314Test-1306254640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:09:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-24ef439a-7a2a-4169-89c9-263faf1b8895 tempest-GroupsV314Test-1306254640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-24ef439a-7a2a-4169-89c9-263faf1b8895 tempest-GroupsV314Test-1306254640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:19 devstack sudo[86261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:09:19 devstack sudo[86261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:20 devstack sudo[86259]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df499d8d-14de-4536-b48f-d502137f8d20 tempest-SnapshotsActionsTest-1847495719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.info" returned: 0 in 0.468s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:20 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-df499d8d-14de-4536-b48f-d502137f8d20 tempest-SnapshotsActionsTest-1847495719 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.info is being set with open permissions: ugo+rw Apr 27 10:09:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df499d8d-14de-4536-b48f-d502137f8d20 tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:20 devstack sudo[86264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.info Apr 27 10:09:20 devstack sudo[86264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:20 devstack sudo[86261]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-24ef439a-7a2a-4169-89c9-263faf1b8895 tempest-GroupsV314Test-1306254640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.468s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:20 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-24ef439a-7a2a-4169-89c9-263faf1b8895 tempest-GroupsV314Test-1306254640 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:09:20 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-24ef439a-7a2a-4169-89c9-263faf1b8895 tempest-GroupsV314Test-1306254640 None] Delete group completed successfully. Apr 27 10:09:20 devstack sudo[86264]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df499d8d-14de-4536-b48f-d502137f8d20 tempest-SnapshotsActionsTest-1847495719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.info" returned: 0 in 0.482s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-df499d8d-14de-4536-b48f-d502137f8d20 tempest-SnapshotsActionsTest-1847495719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.226s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.897s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:20 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-153977869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7284f2c4-8e03-4e5a-8580-7cfa3a503df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='657a81319c3d444b8338f14a460cb651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:09:07Z,use_quota=True,user_id='945a78b202af46549091d37cb6b4e418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:09:20 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Creating volume 7284f2c4-8e03-4e5a-8580-7cfa3a503df9 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:09:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:20 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:09:20 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:09:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:20 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:09:20 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:09:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7284f2c4-8e03-4e5a-8580-7cfa3a503df9 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:20 devstack sudo[86268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7284f2c4-8e03-4e5a-8580-7cfa3a503df9 1073741824 Apr 27 10:09:20 devstack sudo[86268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:20 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-df499d8d-14de-4536-b48f-d502137f8d20 tempest-SnapshotsActionsTest-1847495719 None] Create snapshot completed successfully Apr 27 10:09:20 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3edb1b43-1b12-43e9-b494-07b0cfc27531 tempest-GroupsV314Test-1306254640 None] Acquiring lock "cinder-quobyte-cf2cadd0-92fd-4346-ac11-732846c13171" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:20 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3edb1b43-1b12-43e9-b494-07b0cfc27531 tempest-GroupsV314Test-1306254640 None] Lock "cinder-quobyte-cf2cadd0-92fd-4346-ac11-732846c13171" acquired by "delete_volume" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:20 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c704c030-3f00-4a69-b52c-83887b2292f1]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3edb1b43-1b12-43e9-b494-07b0cfc27531 tempest-GroupsV314Test-1306254640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:21 devstack sudo[86270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171 Apr 27 10:09:21 devstack sudo[86270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:21 devstack sudo[86268]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7284f2c4-8e03-4e5a-8580-7cfa3a503df9 1073741824" returned: 0 in 0.686s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7284f2c4-8e03-4e5a-8580-7cfa3a503df9 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:21 devstack sudo[86275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7284f2c4-8e03-4e5a-8580-7cfa3a503df9 Apr 27 10:09:21 devstack sudo[86275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:21 devstack sudo[86270]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3edb1b43-1b12-43e9-b494-07b0cfc27531 tempest-GroupsV314Test-1306254640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171" returned: 0 in 0.629s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3edb1b43-1b12-43e9-b494-07b0cfc27531 tempest-GroupsV314Test-1306254640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:21 devstack sudo[86280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171 Apr 27 10:09:21 devstack sudo[86280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:21 devstack sudo[86275]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7284f2c4-8e03-4e5a-8580-7cfa3a503df9" returned: 0 in 0.512s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:21 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:09:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.784s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:21 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1633280857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cd63c6-05d5-4694-8765-8696d89c6d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='657a81319c3d444b8338f14a460cb651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:09:07Z,use_quota=True,user_id='945a78b202af46549091d37cb6b4e418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:09:21 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Creating volume 62cd63c6-05d5-4694-8765-8696d89c6d2b {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:09:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:21 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:09:21 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:09:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:21 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:09:21 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:09:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-62cd63c6-05d5-4694-8765-8696d89c6d2b 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a03f07-60d0-441d-86e3-a4eb0fdb4cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7284f2c4-8e03-4e5a-8580-7cfa3a503df9', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca6fefdc-b228-4aec-a7e9-3356d59b76fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:21 devstack sudo[86283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-62cd63c6-05d5-4694-8765-8696d89c6d2b 1073741824 Apr 27 10:09:21 devstack sudo[86283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:21 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Volume volume-7284f2c4-8e03-4e5a-8580-7cfa3a503df9 (7284f2c4-8e03-4e5a-8580-7cfa3a503df9): created successfully Apr 27 10:09:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca6fefdc-b228-4aec-a7e9-3356d59b76fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Flow 'volume_create_manager' (22763975-c723-4e7c-bd3f-94656c3b16cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:09:21 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-66f58592-d57f-45ee-a029-3da2f3a72fad tempest-CreateVolumesFromImageTest-1193943018 None] Created volume successfully. Apr 27 10:09:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8b4e5ae9-1c43-410f-ab49-e5c78c79ae6d tempest-SnapshotsActionsTest-1847495719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:22 devstack sudo[86280]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3edb1b43-1b12-43e9-b494-07b0cfc27531 tempest-GroupsV314Test-1306254640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-cf2cadd0-92fd-4346-ac11-732846c13171" returned: 0 in 0.551s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:22 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3edb1b43-1b12-43e9-b494-07b0cfc27531 tempest-GroupsV314Test-1306254640 None] Lock "cinder-quobyte-cf2cadd0-92fd-4346-ac11-732846c13171" released by "delete_volume" :: held 1.240s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:22 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-3edb1b43-1b12-43e9-b494-07b0cfc27531 tempest-GroupsV314Test-1306254640 None] Created reservations ['9490c13f-9f38-4d2b-8a0d-c5ffae7a0ccf'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:09:22 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-3edb1b43-1b12-43e9-b494-07b0cfc27531 tempest-GroupsV314Test-1306254640 None] Created reservations ['cd3bada3-bf9f-442e-9978-ef49dbf54f75', '634af137-bafa-416b-9e47-feaa4792ab3d', '7fa35c8e-dfb8-4beb-8788-91b93554ac78', 'e51f2909-fc66-4235-a685-b711f35cb9ba'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:09:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3edb1b43-1b12-43e9-b494-07b0cfc27531 tempest-GroupsV314Test-1306254640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3edb1b43-1b12-43e9-b494-07b0cfc27531 tempest-GroupsV314Test-1306254640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:22 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3edb1b43-1b12-43e9-b494-07b0cfc27531 tempest-GroupsV314Test-1306254640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:09:22 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3edb1b43-1b12-43e9-b494-07b0cfc27531 tempest-GroupsV314Test-1306254640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:09:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3edb1b43-1b12-43e9-b494-07b0cfc27531 tempest-GroupsV314Test-1306254640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3edb1b43-1b12-43e9-b494-07b0cfc27531 tempest-GroupsV314Test-1306254640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:22 devstack sudo[86289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:09:22 devstack sudo[86289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:22 devstack sudo[86283]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-62cd63c6-05d5-4694-8765-8696d89c6d2b 1073741824" returned: 0 in 0.755s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-62cd63c6-05d5-4694-8765-8696d89c6d2b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:22 devstack sudo[86291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-62cd63c6-05d5-4694-8765-8696d89c6d2b Apr 27 10:09:22 devstack sudo[86291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:22 devstack sudo[86289]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3edb1b43-1b12-43e9-b494-07b0cfc27531 tempest-GroupsV314Test-1306254640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.470s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:22 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-3edb1b43-1b12-43e9-b494-07b0cfc27531 tempest-GroupsV314Test-1306254640 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:09:22 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-3edb1b43-1b12-43e9-b494-07b0cfc27531 tempest-GroupsV314Test-1306254640 None] Delete group completed successfully. Apr 27 10:09:23 devstack sudo[86291]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-62cd63c6-05d5-4694-8765-8696d89c6d2b" returned: 0 in 0.478s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:23 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:09:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.847s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:23 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-171287879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf38311-1bea-4b13-8826-3b6478cfb311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='657a81319c3d444b8338f14a460cb651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:09:07Z,use_quota=True,user_id='945a78b202af46549091d37cb6b4e418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:09:23 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Creating volume abf38311-1bea-4b13-8826-3b6478cfb311 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:09:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:23 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:09:23 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:09:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:23 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:09:23 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:09:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-abf38311-1bea-4b13-8826-3b6478cfb311 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:23 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678f8487-bd38-48e8-94f8-020ae57f2525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62cd63c6-05d5-4694-8765-8696d89c6d2b', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:23 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92e2fe2-8fbd-4282-990b-920bea18de32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:23 devstack sudo[86295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-abf38311-1bea-4b13-8826-3b6478cfb311 1073741824 Apr 27 10:09:23 devstack sudo[86295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:23 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Volume volume-62cd63c6-05d5-4694-8765-8696d89c6d2b (62cd63c6-05d5-4694-8765-8696d89c6d2b): created successfully Apr 27 10:09:23 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92e2fe2-8fbd-4282-990b-920bea18de32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:23 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Flow 'volume_create_manager' (6c2b98b8-91cc-47a4-85fe-a97bc4de4a51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:09:23 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-4141d49b-8c09-45fa-bb83-c0e6995971de tempest-CreateVolumesFromImageTest-1193943018 None] Created volume successfully. Apr 27 10:09:23 devstack sudo[86295]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-abf38311-1bea-4b13-8826-3b6478cfb311 1073741824" returned: 0 in 0.674s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-abf38311-1bea-4b13-8826-3b6478cfb311 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:23 devstack sudo[86300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-abf38311-1bea-4b13-8826-3b6478cfb311 Apr 27 10:09:23 devstack sudo[86300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:24 devstack sudo[86300]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-abf38311-1bea-4b13-8826-3b6478cfb311" returned: 0 in 0.507s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:24 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:09:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.730s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:24 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-938141010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9858f4a-896f-4f4d-a182-38a26de798e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='657a81319c3d444b8338f14a460cb651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:09:08Z,use_quota=True,user_id='945a78b202af46549091d37cb6b4e418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:09:24 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Creating volume d9858f4a-896f-4f4d-a182-38a26de798e3 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:09:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:24 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:09:24 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:09:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:24 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:09:24 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:09:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d9858f4a-896f-4f4d-a182-38a26de798e3 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a677efcb-f4b3-436a-9fc5-ef8cccb6b9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abf38311-1bea-4b13-8826-3b6478cfb311', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e14f341-2664-4e21-8500-fbe04ea9e676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:24 devstack sudo[86303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d9858f4a-896f-4f4d-a182-38a26de798e3 1073741824 Apr 27 10:09:24 devstack sudo[86303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:24 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Volume volume-abf38311-1bea-4b13-8826-3b6478cfb311 (abf38311-1bea-4b13-8826-3b6478cfb311): created successfully Apr 27 10:09:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e14f341-2664-4e21-8500-fbe04ea9e676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:24 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Flow 'volume_create_manager' (2384bf90-b247-4331-a57a-ace0a28854df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:09:24 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-867e1303-1267-48db-9160-2e64b38ca277 tempest-CreateVolumesFromImageTest-1193943018 None] Created volume successfully. Apr 27 10:09:25 devstack sudo[86303]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d9858f4a-896f-4f4d-a182-38a26de798e3 1073741824" returned: 0 in 0.748s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d9858f4a-896f-4f4d-a182-38a26de798e3 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:25 devstack sudo[86309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d9858f4a-896f-4f4d-a182-38a26de798e3 Apr 27 10:09:25 devstack sudo[86309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:25 devstack sudo[86309]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d9858f4a-896f-4f4d-a182-38a26de798e3" returned: 0 in 0.509s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:25 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:09:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.662s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:25 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2140723313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c013ef7-db61-48f7-a0fa-f1be8d18f0b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='657a81319c3d444b8338f14a460cb651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:09:08Z,use_quota=True,user_id='945a78b202af46549091d37cb6b4e418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:09:25 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Creating volume 3c013ef7-db61-48f7-a0fa-f1be8d18f0b4 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:09:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:25 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:09:25 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:09:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:25 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:09:25 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:09:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3c013ef7-db61-48f7-a0fa-f1be8d18f0b4 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:25 devstack sudo[86312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3c013ef7-db61-48f7-a0fa-f1be8d18f0b4 1073741824 Apr 27 10:09:25 devstack sudo[86312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d47094d-9057-481e-a0da-1dfbb7df1b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9858f4a-896f-4f4d-a182-38a26de798e3', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ffe04b-eb73-4932-88c2-bd9955689751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:25 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Volume volume-d9858f4a-896f-4f4d-a182-38a26de798e3 (d9858f4a-896f-4f4d-a182-38a26de798e3): created successfully Apr 27 10:09:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ffe04b-eb73-4932-88c2-bd9955689751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Flow 'volume_create_manager' (f0793da8-33fc-4d5b-8ecf-f951d36819a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:09:25 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-44993fcd-79da-4e22-96a4-66d85bd683d2 tempest-CreateVolumesFromImageTest-1193943018 None] Created volume successfully. Apr 27 10:09:26 devstack sudo[86312]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3c013ef7-db61-48f7-a0fa-f1be8d18f0b4 1073741824" returned: 0 in 0.747s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3c013ef7-db61-48f7-a0fa-f1be8d18f0b4 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:26 devstack sudo[86317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3c013ef7-db61-48f7-a0fa-f1be8d18f0b4 Apr 27 10:09:26 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:26 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3c013ef7-db61-48f7-a0fa-f1be8d18f0b4" returned: 0 in 0.509s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:09:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.108s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:09:11Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7745614c785f4446ae5e26e4ac4b0644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:09:12Z,use_quota=True,user_id='0ff7d28488cd45a3924a8cc6ed95a14e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:09:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Creating volume b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:09:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:09:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:09:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:09:26 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:09:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7377815c-a6e6-4734-ba05-115982505c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c013ef7-db61-48f7-a0fa-f1be8d18f0b4', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:27 devstack sudo[86320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 1073741824 Apr 27 10:09:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9fe2a1-b678-4bc0-bc49-c8c8479430fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:27 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:27 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Volume volume-3c013ef7-db61-48f7-a0fa-f1be8d18f0b4 (3c013ef7-db61-48f7-a0fa-f1be8d18f0b4): created successfully Apr 27 10:09:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9fe2a1-b678-4bc0-bc49-c8c8479430fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Flow 'volume_create_manager' (2fa746d3-a785-483b-872d-6ec601682840) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:09:27 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-23ec60b8-1bd4-42ba-96c2-32b444d6202e tempest-CreateVolumesFromImageTest-1193943018 None] Created volume successfully. Apr 27 10:09:27 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 1073741824" returned: 0 in 0.707s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:27 devstack sudo[86325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 Apr 27 10:09:27 devstack sudo[86325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:28 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-af0b8661-6e2b-48d8-bd97-5fe9a65916c6 tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "cinder-3c013ef7-db61-48f7-a0fa-f1be8d18f0b4-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:28 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-af0b8661-6e2b-48d8-bd97-5fe9a65916c6 tempest-CreateVolumesFromImageTest-1193943018 None] Lock "cinder-3c013ef7-db61-48f7-a0fa-f1be8d18f0b4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:28 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-af0b8661-6e2b-48d8-bd97-5fe9a65916c6 tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "cinder-quobyte-3c013ef7-db61-48f7-a0fa-f1be8d18f0b4" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:28 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-af0b8661-6e2b-48d8-bd97-5fe9a65916c6 tempest-CreateVolumesFromImageTest-1193943018 None] Lock "cinder-quobyte-3c013ef7-db61-48f7-a0fa-f1be8d18f0b4" acquired by "delete_volume" :: waited 0.017s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:28 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e791eff0-981a-4245-9393-6307e00769cf]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-af0b8661-6e2b-48d8-bd97-5fe9a65916c6 tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3c013ef7-db61-48f7-a0fa-f1be8d18f0b4 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:28 devstack sudo[86325]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2" returned: 0 in 0.554s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:28 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:09:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8b4e5ae9-1c43-410f-ab49-e5c78c79ae6d tempest-SnapshotsActionsTest-1847495719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.329s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:28 devstack sudo[86328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3c013ef7-db61-48f7-a0fa-f1be8d18f0b4 Apr 27 10:09:28 devstack sudo[86328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:28 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-8b4e5ae9-1c43-410f-ab49-e5c78c79ae6d tempest-SnapshotsActionsTest-1847495719 None] Creating offline snapshot 6ec47417-793e-4ded-a88a-d853513eadbd of volume 01b7daeb-5dd1-40f5-ba81-36b302279142 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:09:28 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52e1a9a-9720-45f2-80d3-cbaa5050f8c0]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8b4e5ae9-1c43-410f-ab49-e5c78c79ae6d tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:28 devstack cinder-volume[81350]: DEBUG cinder.volume.volume_utils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Attempting download of d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa ((None, [{'url': 'file:///opt/stack/data/glance/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'metadata': {}}])) to volume b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2. {{(pid=81350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 27 10:09:28 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2462c8b1-c1eb-4f55-a291-cadc094b81ed]: (4, 'raw') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_6z7x37lp {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:28 devstack sudo[86330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b Apr 27 10:09:28 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:28 devstack sudo[86331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_6z7x37lp Apr 27 10:09:28 devstack sudo[86331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:28 devstack sudo[86328]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-af0b8661-6e2b-48d8-bd97-5fe9a65916c6 tempest-CreateVolumesFromImageTest-1193943018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3c013ef7-db61-48f7-a0fa-f1be8d18f0b4" returned: 0 in 0.676s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-af0b8661-6e2b-48d8-bd97-5fe9a65916c6 tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3c013ef7-db61-48f7-a0fa-f1be8d18f0b4 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:28 devstack sudo[86340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3c013ef7-db61-48f7-a0fa-f1be8d18f0b4 Apr 27 10:09:28 devstack sudo[86340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:29 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8b4e5ae9-1c43-410f-ab49-e5c78c79ae6d tempest-SnapshotsActionsTest-1847495719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b" returned: 0 in 0.684s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:29 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-8b4e5ae9-1c43-410f-ab49-e5c78c79ae6d tempest-SnapshotsActionsTest-1847495719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01b7daeb-5dd1-40f5-ba81-36b302279142(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:09:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8b4e5ae9-1c43-410f-ab49-e5c78c79ae6d tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.6ec47417-793e-4ded-a88a-d853513eadbd 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:29 devstack sudo[86344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.6ec47417-793e-4ded-a88a-d853513eadbd 1G Apr 27 10:09:29 devstack sudo[86344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:29 devstack sudo[86331]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_6z7x37lp" returned: 0 in 0.664s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_6z7x37lp {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:29 devstack sudo[86346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_6z7x37lp Apr 27 10:09:29 devstack sudo[86346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:29 devstack sudo[86340]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-af0b8661-6e2b-48d8-bd97-5fe9a65916c6 tempest-CreateVolumesFromImageTest-1193943018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3c013ef7-db61-48f7-a0fa-f1be8d18f0b4" returned: 0 in 0.727s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:29 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-af0b8661-6e2b-48d8-bd97-5fe9a65916c6 tempest-CreateVolumesFromImageTest-1193943018 None] Lock "cinder-quobyte-3c013ef7-db61-48f7-a0fa-f1be8d18f0b4" released by "delete_volume" :: held 1.445s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:29 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-af0b8661-6e2b-48d8-bd97-5fe9a65916c6 tempest-CreateVolumesFromImageTest-1193943018 None] Created reservations ['51261ea4-6854-43c1-8344-8e62cb054e08', 'b06ba4c7-c8b4-4187-987e-e5f573b88f7d', 'a437e2eb-ef71-49bf-be90-cbca73fe9441', 'fc5c6704-e2ba-4bee-a736-f77408351cf5'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:09:29 devstack sudo[86346]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_6z7x37lp" returned: 1 in 0.661s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_6z7x37lp' failed. Not Retrying. {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 10:09:29 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a2db03-9d90-4157-a49d-5a6be19d65b0]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_d5kpq_dqdevstack@QuobyteHD {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-af0b8661-6e2b-48d8-bd97-5fe9a65916c6 tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-af0b8661-6e2b-48d8-bd97-5fe9a65916c6 tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:29 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-af0b8661-6e2b-48d8-bd97-5fe9a65916c6 tempest-CreateVolumesFromImageTest-1193943018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:09:29 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-af0b8661-6e2b-48d8-bd97-5fe9a65916c6 tempest-CreateVolumesFromImageTest-1193943018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:09:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-af0b8661-6e2b-48d8-bd97-5fe9a65916c6 tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-af0b8661-6e2b-48d8-bd97-5fe9a65916c6 tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:29 devstack sudo[86355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:09:29 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:29 devstack sudo[86354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_d5kpq_dqdevstack@QuobyteHD Apr 27 10:09:29 devstack sudo[86354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:29 devstack sudo[86344]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8b4e5ae9-1c43-410f-ab49-e5c78c79ae6d tempest-SnapshotsActionsTest-1847495719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.6ec47417-793e-4ded-a88a-d853513eadbd 1G" returned: 0 in 0.838s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8b4e5ae9-1c43-410f-ab49-e5c78c79ae6d tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.6ec47417-793e-4ded-a88a-d853513eadbd {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:29 devstack sudo[86358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.6ec47417-793e-4ded-a88a-d853513eadbd Apr 27 10:09:29 devstack sudo[86358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:30 devstack sudo[86354]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_d5kpq_dqdevstack@QuobyteHD" returned: 0 in 0.611s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:30 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa was qcow2, converting to raw {{(pid=81350) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 27 10:09:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_d5kpq_dqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:30 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-af0b8661-6e2b-48d8-bd97-5fe9a65916c6 tempest-CreateVolumesFromImageTest-1193943018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.566s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:30 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-af0b8661-6e2b-48d8-bd97-5fe9a65916c6 tempest-CreateVolumesFromImageTest-1193943018 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:09:30 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-af0b8661-6e2b-48d8-bd97-5fe9a65916c6 tempest-CreateVolumesFromImageTest-1193943018 None] Deleted volume successfully. Apr 27 10:09:30 devstack sudo[86364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_d5kpq_dqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 Apr 27 10:09:30 devstack sudo[86364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-af0b8661-6e2b-48d8-bd97-5fe9a65916c6 tempest-CreateVolumesFromImageTest-1193943018 None] Lock "cinder-3c013ef7-db61-48f7-a0fa-f1be8d18f0b4-delete_volume" released by "delete_volume" :: held 2.316s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b81f40dc-f04c-4d20-8e57-3be3254b032a tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "cinder-d9858f4a-896f-4f4d-a182-38a26de798e3-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b81f40dc-f04c-4d20-8e57-3be3254b032a tempest-CreateVolumesFromImageTest-1193943018 None] Lock "cinder-d9858f4a-896f-4f4d-a182-38a26de798e3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b81f40dc-f04c-4d20-8e57-3be3254b032a tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "cinder-quobyte-d9858f4a-896f-4f4d-a182-38a26de798e3" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b81f40dc-f04c-4d20-8e57-3be3254b032a tempest-CreateVolumesFromImageTest-1193943018 None] Lock "cinder-quobyte-d9858f4a-896f-4f4d-a182-38a26de798e3" acquired by "delete_volume" :: waited 0.030s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:30 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8c7396-d30f-4318-b4ef-fbe8981659cb]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b81f40dc-f04c-4d20-8e57-3be3254b032a tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d9858f4a-896f-4f4d-a182-38a26de798e3 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:30 devstack sudo[86358]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8b4e5ae9-1c43-410f-ab49-e5c78c79ae6d tempest-SnapshotsActionsTest-1847495719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.6ec47417-793e-4ded-a88a-d853513eadbd" returned: 0 in 0.764s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:30 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-8b4e5ae9-1c43-410f-ab49-e5c78c79ae6d tempest-SnapshotsActionsTest-1847495719 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.6ec47417-793e-4ded-a88a-d853513eadbd is being set with open permissions: ugo+rw Apr 27 10:09:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8b4e5ae9-1c43-410f-ab49-e5c78c79ae6d tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.6ec47417-793e-4ded-a88a-d853513eadbd {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:30 devstack sudo[86372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.6ec47417-793e-4ded-a88a-d853513eadbd Apr 27 10:09:30 devstack sudo[86372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:30 devstack sudo[86371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d9858f4a-896f-4f4d-a182-38a26de798e3 Apr 27 10:09:30 devstack sudo[86371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:31 devstack sudo[86372]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8b4e5ae9-1c43-410f-ab49-e5c78c79ae6d tempest-SnapshotsActionsTest-1847495719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.6ec47417-793e-4ded-a88a-d853513eadbd" returned: 0 in 0.553s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8b4e5ae9-1c43-410f-ab49-e5c78c79ae6d tempest-SnapshotsActionsTest-1847495719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.959s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:31 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-8b4e5ae9-1c43-410f-ab49-e5c78c79ae6d tempest-SnapshotsActionsTest-1847495719 None] Create snapshot completed successfully Apr 27 10:09:31 devstack sudo[86371]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b81f40dc-f04c-4d20-8e57-3be3254b032a tempest-CreateVolumesFromImageTest-1193943018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d9858f4a-896f-4f4d-a182-38a26de798e3" returned: 0 in 0.682s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b81f40dc-f04c-4d20-8e57-3be3254b032a tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d9858f4a-896f-4f4d-a182-38a26de798e3 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:31 devstack sudo[86385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d9858f4a-896f-4f4d-a182-38a26de798e3 Apr 27 10:09:31 devstack sudo[86385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1e7be8c2-944c-493a-abae-6bf38fd1abba tempest-SnapshotsActionsTest-1756105371 None] Acquiring lock "cinder-6ec47417-793e-4ded-a88a-d853513eadbd-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1e7be8c2-944c-493a-abae-6bf38fd1abba tempest-SnapshotsActionsTest-1756105371 None] Lock "cinder-6ec47417-793e-4ded-a88a-d853513eadbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1e7be8c2-944c-493a-abae-6bf38fd1abba tempest-SnapshotsActionsTest-1756105371 None] Acquiring lock "cinder-quobyte-01b7daeb-5dd1-40f5-ba81-36b302279142" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1e7be8c2-944c-493a-abae-6bf38fd1abba tempest-SnapshotsActionsTest-1756105371 None] Lock "cinder-quobyte-01b7daeb-5dd1-40f5-ba81-36b302279142" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1e7be8c2-944c-493a-abae-6bf38fd1abba tempest-SnapshotsActionsTest-1756105371 None] Acquiring lock "cinder-quobyte-6ec47417-793e-4ded-a88a-d853513eadbd" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1e7be8c2-944c-493a-abae-6bf38fd1abba tempest-SnapshotsActionsTest-1756105371 None] Lock "cinder-quobyte-6ec47417-793e-4ded-a88a-d853513eadbd" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:31 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-1e7be8c2-944c-493a-abae-6bf38fd1abba tempest-SnapshotsActionsTest-1756105371 None] Deleting offline snapshot 6ec47417-793e-4ded-a88a-d853513eadbd of volume 01b7daeb-5dd1-40f5-ba81-36b302279142 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:09:31 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-1e7be8c2-944c-493a-abae-6bf38fd1abba tempest-SnapshotsActionsTest-1756105371 None] snapshot_file for this snap is: volume-01b7daeb-5dd1-40f5-ba81-36b302279142.6ec47417-793e-4ded-a88a-d853513eadbd {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:09:31 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87cda0b-675b-45d6-aa58-770aa62cc993]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1e7be8c2-944c-493a-abae-6bf38fd1abba tempest-SnapshotsActionsTest-1756105371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.6ec47417-793e-4ded-a88a-d853513eadbd {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:31 devstack sudo[86387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.6ec47417-793e-4ded-a88a-d853513eadbd Apr 27 10:09:31 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:31 devstack sudo[86385]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b81f40dc-f04c-4d20-8e57-3be3254b032a tempest-CreateVolumesFromImageTest-1193943018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d9858f4a-896f-4f4d-a182-38a26de798e3" returned: 0 in 0.642s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b81f40dc-f04c-4d20-8e57-3be3254b032a tempest-CreateVolumesFromImageTest-1193943018 None] Lock "cinder-quobyte-d9858f4a-896f-4f4d-a182-38a26de798e3" released by "delete_volume" :: held 1.382s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:32 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-b81f40dc-f04c-4d20-8e57-3be3254b032a tempest-CreateVolumesFromImageTest-1193943018 None] Created reservations ['aa87f52b-6eef-4ee0-8b8c-4ef4e2df09b4', '4e5f2c4f-ce4d-42d5-a3e5-60c552e1c569', '57df7b96-2f18-4491-b128-40f5b2a06080', 'bfbdf896-5649-43a0-88a1-54a4f737fbe8'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:09:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b81f40dc-f04c-4d20-8e57-3be3254b032a tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b81f40dc-f04c-4d20-8e57-3be3254b032a tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b81f40dc-f04c-4d20-8e57-3be3254b032a tempest-CreateVolumesFromImageTest-1193943018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:09:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b81f40dc-f04c-4d20-8e57-3be3254b032a tempest-CreateVolumesFromImageTest-1193943018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:09:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b81f40dc-f04c-4d20-8e57-3be3254b032a tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b81f40dc-f04c-4d20-8e57-3be3254b032a tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:32 devstack sudo[86390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:09:32 devstack sudo[86390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:32 devstack sudo[86364]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_d5kpq_dqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2" returned: 0 in 1.920s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:32 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_d5kpq_dqdevstack@QuobyteHD, size 112.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 {{(pid=81350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 10:09:32 devstack cinder-volume[81350]: INFO cinder.image.image_utils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Converted 112.00 MB image at 58.26 MB/s Apr 27 10:09:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:32 devstack sudo[86395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 1G Apr 27 10:09:32 devstack sudo[86395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:32 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1e7be8c2-944c-493a-abae-6bf38fd1abba tempest-SnapshotsActionsTest-1756105371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.6ec47417-793e-4ded-a88a-d853513eadbd" returned: 0 in 0.797s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-1e7be8c2-944c-493a-abae-6bf38fd1abba tempest-SnapshotsActionsTest-1756105371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01b7daeb-5dd1-40f5-ba81-36b302279142(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:09:32 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7f5c84-6cb7-4ed8-95c1-b6220e6d2ca4]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1e7be8c2-944c-493a-abae-6bf38fd1abba tempest-SnapshotsActionsTest-1756105371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:32 devstack sudo[86397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b Apr 27 10:09:32 devstack sudo[86397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d410fcd4-c2a9-4ba0-90e3-831f34634c3d tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "cinder-abf38311-1bea-4b13-8826-3b6478cfb311-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d410fcd4-c2a9-4ba0-90e3-831f34634c3d tempest-CreateVolumesFromImageTest-1193943018 None] Lock "cinder-abf38311-1bea-4b13-8826-3b6478cfb311-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d410fcd4-c2a9-4ba0-90e3-831f34634c3d tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "cinder-quobyte-abf38311-1bea-4b13-8826-3b6478cfb311" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d410fcd4-c2a9-4ba0-90e3-831f34634c3d tempest-CreateVolumesFromImageTest-1193943018 None] Lock "cinder-quobyte-abf38311-1bea-4b13-8826-3b6478cfb311" acquired by "delete_volume" :: waited 0.019s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:32 devstack sudo[86390]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b81f40dc-f04c-4d20-8e57-3be3254b032a tempest-CreateVolumesFromImageTest-1193943018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.723s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:32 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-b81f40dc-f04c-4d20-8e57-3be3254b032a tempest-CreateVolumesFromImageTest-1193943018 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:09:32 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-b81f40dc-f04c-4d20-8e57-3be3254b032a tempest-CreateVolumesFromImageTest-1193943018 None] Deleted volume successfully. Apr 27 10:09:32 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d333d3-a3f0-494c-b929-59a68bce5d41]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d410fcd4-c2a9-4ba0-90e3-831f34634c3d tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-abf38311-1bea-4b13-8826-3b6478cfb311 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b81f40dc-f04c-4d20-8e57-3be3254b032a tempest-CreateVolumesFromImageTest-1193943018 None] Lock "cinder-d9858f4a-896f-4f4d-a182-38a26de798e3-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:33 devstack sudo[86403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-abf38311-1bea-4b13-8826-3b6478cfb311 Apr 27 10:09:33 devstack sudo[86403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:33 devstack sudo[86395]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 1G" returned: 0 in 0.828s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:33 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70605d5-c959-4630-957a-3e11a5ab90ad]: (4, 'raw') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:33 devstack sudo[86397]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1e7be8c2-944c-493a-abae-6bf38fd1abba tempest-SnapshotsActionsTest-1756105371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b" returned: 0 in 0.665s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:33 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-1e7be8c2-944c-493a-abae-6bf38fd1abba tempest-SnapshotsActionsTest-1756105371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01b7daeb-5dd1-40f5-ba81-36b302279142(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:09:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1e7be8c2-944c-493a-abae-6bf38fd1abba tempest-SnapshotsActionsTest-1756105371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.6ec47417-793e-4ded-a88a-d853513eadbd {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:33 devstack sudo[86412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.6ec47417-793e-4ded-a88a-d853513eadbd Apr 27 10:09:33 devstack sudo[86412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:33 devstack sudo[86411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 Apr 27 10:09:33 devstack sudo[86411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:33 devstack sudo[86403]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d410fcd4-c2a9-4ba0-90e3-831f34634c3d tempest-CreateVolumesFromImageTest-1193943018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-abf38311-1bea-4b13-8826-3b6478cfb311" returned: 0 in 0.700s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d410fcd4-c2a9-4ba0-90e3-831f34634c3d tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-abf38311-1bea-4b13-8826-3b6478cfb311 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:33 devstack sudo[86418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-abf38311-1bea-4b13-8826-3b6478cfb311 Apr 27 10:09:33 devstack sudo[86418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:33 devstack sudo[86411]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2" returned: 0 in 0.650s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:33 devstack sudo[86425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 Apr 27 10:09:33 devstack sudo[86425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:34 devstack sudo[86412]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1e7be8c2-944c-493a-abae-6bf38fd1abba tempest-SnapshotsActionsTest-1756105371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.6ec47417-793e-4ded-a88a-d853513eadbd" returned: 0 in 0.831s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1e7be8c2-944c-493a-abae-6bf38fd1abba tempest-SnapshotsActionsTest-1756105371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.6ec47417-793e-4ded-a88a-d853513eadbd {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:34 devstack sudo[86427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.6ec47417-793e-4ded-a88a-d853513eadbd Apr 27 10:09:34 devstack sudo[86427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:34 devstack sudo[86418]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d410fcd4-c2a9-4ba0-90e3-831f34634c3d tempest-CreateVolumesFromImageTest-1193943018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-abf38311-1bea-4b13-8826-3b6478cfb311" returned: 0 in 0.718s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d410fcd4-c2a9-4ba0-90e3-831f34634c3d tempest-CreateVolumesFromImageTest-1193943018 None] Lock "cinder-quobyte-abf38311-1bea-4b13-8826-3b6478cfb311" released by "delete_volume" :: held 1.475s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-d410fcd4-c2a9-4ba0-90e3-831f34634c3d tempest-CreateVolumesFromImageTest-1193943018 None] Created reservations ['a2b60e49-e87c-48de-9904-9bfb084064a1', 'c867cac2-023e-4d66-b46d-052e0f26686e', 'b0d8b71c-30e7-4bed-b2b1-a90a30b9775c', '4ff1ef0d-03fc-4bb6-9eec-a2ab1cdf898a'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d410fcd4-c2a9-4ba0-90e3-831f34634c3d tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d410fcd4-c2a9-4ba0-90e3-831f34634c3d tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d410fcd4-c2a9-4ba0-90e3-831f34634c3d tempest-CreateVolumesFromImageTest-1193943018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d410fcd4-c2a9-4ba0-90e3-831f34634c3d tempest-CreateVolumesFromImageTest-1193943018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d410fcd4-c2a9-4ba0-90e3-831f34634c3d tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d410fcd4-c2a9-4ba0-90e3-831f34634c3d tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:34 devstack sudo[86430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:09:34 devstack sudo[86430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:34 devstack sudo[86427]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1e7be8c2-944c-493a-abae-6bf38fd1abba tempest-SnapshotsActionsTest-1756105371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.6ec47417-793e-4ded-a88a-d853513eadbd" returned: 0 in 0.639s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:34 devstack sudo[86425]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2" returned: 1 in 0.872s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2' failed. Not Retrying. {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG cinder.volume.volume_utils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Downloaded image d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa ((None, [{'url': 'file:///opt/stack/data/glance/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'metadata': {}}])) to volume b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 successfully. {{(pid=81350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Temporary image d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa for user 0ff7d28488cd45a3924a8cc6ed95a14e is deleted. {{(pid=81350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG cinder.volume.volume_utils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Marking volume b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 as bootable. {{(pid=81350) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1e7be8c2-944c-493a-abae-6bf38fd1abba tempest-SnapshotsActionsTest-1756105371 None] Lock "cinder-quobyte-6ec47417-793e-4ded-a88a-d853513eadbd" released by "_delete_snapshot" :: held 3.079s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1e7be8c2-944c-493a-abae-6bf38fd1abba tempest-SnapshotsActionsTest-1756105371 None] Lock "cinder-quobyte-01b7daeb-5dd1-40f5-ba81-36b302279142" released by "delete_snapshot" :: held 3.119s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Copying metadata from image d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa to b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2. {{(pid=81350) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Creating volume glance metadata for volume b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 backed by image d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81350) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-1e7be8c2-944c-493a-abae-6bf38fd1abba tempest-SnapshotsActionsTest-1756105371 None] Created reservations ['65ce7c8d-a2b0-4cf7-a98b-fdc21271fe26', '52aa3b5e-6d7c-453d-964c-67d14d1b12af', 'e1e6c0b9-0051-443e-beee-33e2aff4a0e9', '4580a445-8e88-469a-8cd1-247ec5457471'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b42c7744-3792-4859-aac9-f6f5ee1e0304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2', 'volume_size': 1, 'image_id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f81a6757fcfa47c099a3bbded3b529cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'created_at': datetime.datetime(2026, 4, 27, 7, 59, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 7, 59, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f58b6b6-947e-4468-b313-af5f650b5da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:34 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Volume volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 (b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2): created successfully Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f58b6b6-947e-4468-b313-af5f650b5da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Flow 'volume_create_manager' (27d1df0b-ac26-4382-9f60-eff26b85f791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:09:34 devstack cinder-volume[81350]: INFO cinder.volume.manager [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-47c42840-c591-4ecd-b309-44596a57a53a tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Created volume successfully. Apr 27 10:09:34 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-1e7be8c2-944c-493a-abae-6bf38fd1abba tempest-SnapshotsActionsTest-1756105371 None] Delete snapshot completed successfully. Apr 27 10:09:34 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1e7be8c2-944c-493a-abae-6bf38fd1abba tempest-SnapshotsActionsTest-1756105371 None] Lock "cinder-6ec47417-793e-4ded-a88a-d853513eadbd-delete_snapshot" released by "delete_snapshot" :: held 3.366s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:35 devstack sudo[86430]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d410fcd4-c2a9-4ba0-90e3-831f34634c3d tempest-CreateVolumesFromImageTest-1193943018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.588s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:35 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-d410fcd4-c2a9-4ba0-90e3-831f34634c3d tempest-CreateVolumesFromImageTest-1193943018 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:09:35 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-d410fcd4-c2a9-4ba0-90e3-831f34634c3d tempest-CreateVolumesFromImageTest-1193943018 None] Deleted volume successfully. Apr 27 10:09:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d410fcd4-c2a9-4ba0-90e3-831f34634c3d tempest-CreateVolumesFromImageTest-1193943018 None] Lock "cinder-abf38311-1bea-4b13-8826-3b6478cfb311-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-0a110dbf-9828-4498-89fd-c4a93bf4c645 tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "cinder-62cd63c6-05d5-4694-8765-8696d89c6d2b-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-0a110dbf-9828-4498-89fd-c4a93bf4c645 tempest-CreateVolumesFromImageTest-1193943018 None] Lock "cinder-62cd63c6-05d5-4694-8765-8696d89c6d2b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-0a110dbf-9828-4498-89fd-c4a93bf4c645 tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "cinder-quobyte-62cd63c6-05d5-4694-8765-8696d89c6d2b" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-0a110dbf-9828-4498-89fd-c4a93bf4c645 tempest-CreateVolumesFromImageTest-1193943018 None] Lock "cinder-quobyte-62cd63c6-05d5-4694-8765-8696d89c6d2b" acquired by "delete_volume" :: waited 0.024s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:35 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1568191d-d5f0-4b43-915e-cf955498a225]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0a110dbf-9828-4498-89fd-c4a93bf4c645 tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-62cd63c6-05d5-4694-8765-8696d89c6d2b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:35 devstack sudo[86438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-62cd63c6-05d5-4694-8765-8696d89c6d2b Apr 27 10:09:35 devstack sudo[86438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:35 devstack sudo[86438]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0a110dbf-9828-4498-89fd-c4a93bf4c645 tempest-CreateVolumesFromImageTest-1193943018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-62cd63c6-05d5-4694-8765-8696d89c6d2b" returned: 0 in 0.599s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0a110dbf-9828-4498-89fd-c4a93bf4c645 tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-62cd63c6-05d5-4694-8765-8696d89c6d2b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:35 devstack sudo[86443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-62cd63c6-05d5-4694-8765-8696d89c6d2b Apr 27 10:09:35 devstack sudo[86443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0ce3f9f4-c927-4d4e-943d-2df7be04caf3 tempest-SnapshotsActionsTest-1847495719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0ce3f9f4-c927-4d4e-943d-2df7be04caf3 tempest-SnapshotsActionsTest-1847495719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-0ce3f9f4-c927-4d4e-943d-2df7be04caf3 tempest-SnapshotsActionsTest-1847495719 None] Creating offline snapshot 5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1 of volume 01b7daeb-5dd1-40f5-ba81-36b302279142 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:09:36 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93b10a7-0433-4452-b42c-79e315188354]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0ce3f9f4-c927-4d4e-943d-2df7be04caf3 tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:36 devstack sudo[86445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b Apr 27 10:09:36 devstack sudo[86445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:36 devstack sudo[86443]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0a110dbf-9828-4498-89fd-c4a93bf4c645 tempest-CreateVolumesFromImageTest-1193943018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-62cd63c6-05d5-4694-8765-8696d89c6d2b" returned: 0 in 0.527s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-0a110dbf-9828-4498-89fd-c4a93bf4c645 tempest-CreateVolumesFromImageTest-1193943018 None] Lock "cinder-quobyte-62cd63c6-05d5-4694-8765-8696d89c6d2b" released by "delete_volume" :: held 1.180s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:36 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-0a110dbf-9828-4498-89fd-c4a93bf4c645 tempest-CreateVolumesFromImageTest-1193943018 None] Created reservations ['baac977b-8305-4046-84dd-527dbdfeeb15', '3566d1fb-a02b-49ef-9688-3682ec6ae8c9', '1d3319e6-8d4b-46e8-9fba-4815b7e1502f', '9fe51cbe-df3b-497e-a61e-7b0358836fd2'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:09:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0a110dbf-9828-4498-89fd-c4a93bf4c645 tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0a110dbf-9828-4498-89fd-c4a93bf4c645 tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0a110dbf-9828-4498-89fd-c4a93bf4c645 tempest-CreateVolumesFromImageTest-1193943018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:09:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0a110dbf-9828-4498-89fd-c4a93bf4c645 tempest-CreateVolumesFromImageTest-1193943018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:09:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0a110dbf-9828-4498-89fd-c4a93bf4c645 tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0a110dbf-9828-4498-89fd-c4a93bf4c645 tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:36 devstack sudo[86448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:09:36 devstack sudo[86448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-ef9cfe01-f45e-4986-b6b5-37ee6d307dad tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:36 devstack sudo[86445]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0ce3f9f4-c927-4d4e-943d-2df7be04caf3 tempest-SnapshotsActionsTest-1847495719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b" returned: 0 in 0.762s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-0ce3f9f4-c927-4d4e-943d-2df7be04caf3 tempest-SnapshotsActionsTest-1847495719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01b7daeb-5dd1-40f5-ba81-36b302279142(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:09:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0ce3f9f4-c927-4d4e-943d-2df7be04caf3 tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:36 devstack sudo[86461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1 1G Apr 27 10:09:36 devstack sudo[86461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:37 devstack sudo[86448]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0a110dbf-9828-4498-89fd-c4a93bf4c645 tempest-CreateVolumesFromImageTest-1193943018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.571s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:37 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-0a110dbf-9828-4498-89fd-c4a93bf4c645 tempest-CreateVolumesFromImageTest-1193943018 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:09:37 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-0a110dbf-9828-4498-89fd-c4a93bf4c645 tempest-CreateVolumesFromImageTest-1193943018 None] Deleted volume successfully. Apr 27 10:09:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-0a110dbf-9828-4498-89fd-c4a93bf4c645 tempest-CreateVolumesFromImageTest-1193943018 None] Lock "cinder-62cd63c6-05d5-4694-8765-8696d89c6d2b-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3337d588-b48a-4670-afdf-d46c3796436f tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "cinder-7284f2c4-8e03-4e5a-8580-7cfa3a503df9-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3337d588-b48a-4670-afdf-d46c3796436f tempest-CreateVolumesFromImageTest-1193943018 None] Lock "cinder-7284f2c4-8e03-4e5a-8580-7cfa3a503df9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3337d588-b48a-4670-afdf-d46c3796436f tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "cinder-quobyte-7284f2c4-8e03-4e5a-8580-7cfa3a503df9" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3337d588-b48a-4670-afdf-d46c3796436f tempest-CreateVolumesFromImageTest-1193943018 None] Lock "cinder-quobyte-7284f2c4-8e03-4e5a-8580-7cfa3a503df9" acquired by "delete_volume" :: waited 0.015s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:37 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba6957f-21ff-4a8e-9b96-f9a0983aa102]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3337d588-b48a-4670-afdf-d46c3796436f tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7284f2c4-8e03-4e5a-8580-7cfa3a503df9 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:37 devstack sudo[86467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7284f2c4-8e03-4e5a-8580-7cfa3a503df9 Apr 27 10:09:37 devstack sudo[86467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:37 devstack sudo[86461]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0ce3f9f4-c927-4d4e-943d-2df7be04caf3 tempest-SnapshotsActionsTest-1847495719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1 1G" returned: 0 in 0.710s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0ce3f9f4-c927-4d4e-943d-2df7be04caf3 tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:37 devstack sudo[86469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1 Apr 27 10:09:37 devstack sudo[86469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:38 devstack sudo[86467]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3337d588-b48a-4670-afdf-d46c3796436f tempest-CreateVolumesFromImageTest-1193943018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7284f2c4-8e03-4e5a-8580-7cfa3a503df9" returned: 0 in 0.685s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3337d588-b48a-4670-afdf-d46c3796436f tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7284f2c4-8e03-4e5a-8580-7cfa3a503df9 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:38 devstack sudo[86477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7284f2c4-8e03-4e5a-8580-7cfa3a503df9 Apr 27 10:09:38 devstack sudo[86477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:38 devstack sudo[86469]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0ce3f9f4-c927-4d4e-943d-2df7be04caf3 tempest-SnapshotsActionsTest-1847495719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1" returned: 0 in 0.548s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:38 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-0ce3f9f4-c927-4d4e-943d-2df7be04caf3 tempest-SnapshotsActionsTest-1847495719 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1 is being set with open permissions: ugo+rw Apr 27 10:09:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0ce3f9f4-c927-4d4e-943d-2df7be04caf3 tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:38 devstack sudo[86479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1 Apr 27 10:09:38 devstack sudo[86479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:38 devstack sudo[86477]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3337d588-b48a-4670-afdf-d46c3796436f tempest-CreateVolumesFromImageTest-1193943018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7284f2c4-8e03-4e5a-8580-7cfa3a503df9" returned: 0 in 0.508s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:38 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3337d588-b48a-4670-afdf-d46c3796436f tempest-CreateVolumesFromImageTest-1193943018 None] Lock "cinder-quobyte-7284f2c4-8e03-4e5a-8580-7cfa3a503df9" released by "delete_volume" :: held 1.236s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:38 devstack sudo[86479]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0ce3f9f4-c927-4d4e-943d-2df7be04caf3 tempest-SnapshotsActionsTest-1847495719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1" returned: 0 in 0.484s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0ce3f9f4-c927-4d4e-943d-2df7be04caf3 tempest-SnapshotsActionsTest-1847495719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.624s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-ef9cfe01-f45e-4986-b6b5-37ee6d307dad tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.862s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:38 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2d08cb-3b0b-4af0-b884-8ca14ba3b14e]: (4, 'raw') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-ef9cfe01-f45e-4986-b6b5-37ee6d307dad tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:38 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-0ce3f9f4-c927-4d4e-943d-2df7be04caf3 tempest-SnapshotsActionsTest-1847495719 None] Create snapshot completed successfully Apr 27 10:09:38 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-3337d588-b48a-4670-afdf-d46c3796436f tempest-CreateVolumesFromImageTest-1193943018 None] Created reservations ['ab3eb425-386a-4087-b21e-650fa8fa4e53', '8ee12d92-1305-4483-8267-65293f7f8835', '2842dc45-87bb-4e00-99f7-c1475258c4b0', 'a086d5ab-4662-44e3-b5fb-06f331860b65'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:09:38 devstack sudo[86483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 Apr 27 10:09:38 devstack sudo[86483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3337d588-b48a-4670-afdf-d46c3796436f tempest-CreateVolumesFromImageTest-1193943018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3337d588-b48a-4670-afdf-d46c3796436f tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:38 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3337d588-b48a-4670-afdf-d46c3796436f tempest-CreateVolumesFromImageTest-1193943018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:09:38 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3337d588-b48a-4670-afdf-d46c3796436f tempest-CreateVolumesFromImageTest-1193943018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:09:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3337d588-b48a-4670-afdf-d46c3796436f tempest-CreateVolumesFromImageTest-1193943018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3337d588-b48a-4670-afdf-d46c3796436f tempest-CreateVolumesFromImageTest-1193943018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:38 devstack sudo[86485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:09:38 devstack sudo[86485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:39 devstack sudo[86483]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-ef9cfe01-f45e-4986-b6b5-37ee6d307dad tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2" returned: 0 in 0.625s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-ef9cfe01-f45e-4986-b6b5-37ee6d307dad tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:39 devstack sudo[86485]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3337d588-b48a-4670-afdf-d46c3796436f tempest-CreateVolumesFromImageTest-1193943018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.585s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:39 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-3337d588-b48a-4670-afdf-d46c3796436f tempest-CreateVolumesFromImageTest-1193943018 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:09:39 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-3337d588-b48a-4670-afdf-d46c3796436f tempest-CreateVolumesFromImageTest-1193943018 None] Deleted volume successfully. Apr 27 10:09:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3337d588-b48a-4670-afdf-d46c3796436f tempest-CreateVolumesFromImageTest-1193943018 None] Lock "cinder-7284f2c4-8e03-4e5a-8580-7cfa3a503df9-delete_volume" released by "delete_volume" :: held 2.148s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-6394c02f-90da-45d7-afe4-36cd41c6d99c tempest-SnapshotsActionsTest-1756105371 None] Acquiring lock "cinder-5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:39 devstack sudo[86490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 Apr 27 10:09:39 devstack sudo[86490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-6394c02f-90da-45d7-afe4-36cd41c6d99c tempest-SnapshotsActionsTest-1756105371 None] Lock "cinder-5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-6394c02f-90da-45d7-afe4-36cd41c6d99c tempest-SnapshotsActionsTest-1756105371 None] Acquiring lock "cinder-quobyte-01b7daeb-5dd1-40f5-ba81-36b302279142" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-6394c02f-90da-45d7-afe4-36cd41c6d99c tempest-SnapshotsActionsTest-1756105371 None] Lock "cinder-quobyte-01b7daeb-5dd1-40f5-ba81-36b302279142" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-6394c02f-90da-45d7-afe4-36cd41c6d99c tempest-SnapshotsActionsTest-1756105371 None] Acquiring lock "cinder-quobyte-5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-6394c02f-90da-45d7-afe4-36cd41c6d99c tempest-SnapshotsActionsTest-1756105371 None] Lock "cinder-quobyte-5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:39 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-6394c02f-90da-45d7-afe4-36cd41c6d99c tempest-SnapshotsActionsTest-1756105371 None] Deleting offline snapshot 5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1 of volume 01b7daeb-5dd1-40f5-ba81-36b302279142 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:09:39 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-6394c02f-90da-45d7-afe4-36cd41c6d99c tempest-SnapshotsActionsTest-1756105371 None] snapshot_file for this snap is: volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:09:39 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[935b6003-0206-40ae-9045-8c0c434329e6]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6394c02f-90da-45d7-afe4-36cd41c6d99c tempest-SnapshotsActionsTest-1756105371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:39 devstack sudo[86492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1 Apr 27 10:09:39 devstack sudo[86492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:40 devstack sudo[86490]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-ef9cfe01-f45e-4986-b6b5-37ee6d307dad tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2" returned: 1 in 0.824s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-ef9cfe01-f45e-4986-b6b5-37ee6d307dad tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2' failed. Not Retrying. {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 10:09:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-ef9cfe01-f45e-4986-b6b5-37ee6d307dad tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.493s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:40 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-ef9cfe01-f45e-4986-b6b5-37ee6d307dad tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4', 'name': 'volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b047da96-ffa9-4589-bba4-a8fb0a6e7315', 'enforce_multipath': True} {{(pid=81350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 27 10:09:40 devstack cinder-volume[81350]: INFO cinder.volume.manager [req-cf0dcacd-0d03-46a0-89e3-703eaf2b0cef req-ef9cfe01-f45e-4986-b6b5-37ee6d307dad tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] attachment_update completed successfully. Apr 27 10:09:40 devstack sudo[86492]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6394c02f-90da-45d7-afe4-36cd41c6d99c tempest-SnapshotsActionsTest-1756105371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1" returned: 0 in 0.815s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:40 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-6394c02f-90da-45d7-afe4-36cd41c6d99c tempest-SnapshotsActionsTest-1756105371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01b7daeb-5dd1-40f5-ba81-36b302279142(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:09:40 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f207e11c-0274-42b5-b6a1-12e684d75df5]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6394c02f-90da-45d7-afe4-36cd41c6d99c tempest-SnapshotsActionsTest-1756105371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:40 devstack sudo[86501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b Apr 27 10:09:40 devstack sudo[86501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:41 devstack sudo[86501]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6394c02f-90da-45d7-afe4-36cd41c6d99c tempest-SnapshotsActionsTest-1756105371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b" returned: 0 in 0.781s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-6394c02f-90da-45d7-afe4-36cd41c6d99c tempest-SnapshotsActionsTest-1756105371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01b7daeb-5dd1-40f5-ba81-36b302279142(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:09:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6394c02f-90da-45d7-afe4-36cd41c6d99c tempest-SnapshotsActionsTest-1756105371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:41 devstack sudo[86506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1 Apr 27 10:09:41 devstack sudo[86506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:42 devstack sudo[86506]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6394c02f-90da-45d7-afe4-36cd41c6d99c tempest-SnapshotsActionsTest-1756105371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1" returned: 0 in 0.773s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6394c02f-90da-45d7-afe4-36cd41c6d99c tempest-SnapshotsActionsTest-1756105371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:42 devstack sudo[86511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1 Apr 27 10:09:42 devstack sudo[86511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:09:42 devstack sudo[86511]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Flow 'volume_create_manager' (af3608a1-a1c8-49df-9e79-21046214fa70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a0b569-604e-48c7-b0f1-0753649a4e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6394c02f-90da-45d7-afe4-36cd41c6d99c tempest-SnapshotsActionsTest-1756105371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1" returned: 0 in 0.715s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-6394c02f-90da-45d7-afe4-36cd41c6d99c tempest-SnapshotsActionsTest-1756105371 None] Lock "cinder-quobyte-5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1" released by "_delete_snapshot" :: held 3.196s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a0b569-604e-48c7-b0f1-0753649a4e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-555279230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be8a2475-d68d-4d45-b74d-95030da59fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5be380481e4c83970a7af51231c0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:09:43Z,use_quota=True,user_id='1967be54001c40b09af362c32d730bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00035d1-cbf6-45a4-bf4c-95fee3424ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00035d1-cbf6-45a4-bf4c-95fee3424ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df034d9a-0bd7-4020-9a2b-133f4ead7f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df034d9a-0bd7-4020-9a2b-133f4ead7f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be8a2475-d68d-4d45-b74d-95030da59fd8', 'volume_name': 'volume-be8a2475-d68d-4d45-b74d-95030da59fd8', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a39f89-9e84-4c08-9b4d-b98da99c5fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a39f89-9e84-4c08-9b4d-b98da99c5fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f43b7fa5-18ee-4a82-880b-b43597a2636b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:42 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Volume be8a2475-d68d-4d45-b74d-95030da59fd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be8a2475-d68d-4d45-b74d-95030da59fd8', 'volume_size': 1} Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-555279230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be8a2475-d68d-4d45-b74d-95030da59fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5be380481e4c83970a7af51231c0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:09:43Z,use_quota=True,user_id='1967be54001c40b09af362c32d730bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Creating volume be8a2475-d68d-4d45-b74d-95030da59fd8 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:09:42 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-6394c02f-90da-45d7-afe4-36cd41c6d99c tempest-SnapshotsActionsTest-1756105371 None] Lock "cinder-quobyte-01b7daeb-5dd1-40f5-ba81-36b302279142" released by "delete_snapshot" :: held 3.293s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:42 devstack sudo[86514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8 1073741824 Apr 27 10:09:42 devstack sudo[86514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:42 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-6394c02f-90da-45d7-afe4-36cd41c6d99c tempest-SnapshotsActionsTest-1756105371 None] Created reservations ['14dce491-fe9e-45bd-a8e1-4c8e9fc36d23', '80456969-2ee1-4b96-88e1-0c8f254ac0e0', '2bcb3f69-3075-43c4-87ee-f5a751799d14', '8883431a-8148-47a6-b7f1-13f1fbfa73a1'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:09:43 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-6394c02f-90da-45d7-afe4-36cd41c6d99c tempest-SnapshotsActionsTest-1756105371 None] Delete snapshot completed successfully. Apr 27 10:09:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-6394c02f-90da-45d7-afe4-36cd41c6d99c tempest-SnapshotsActionsTest-1756105371 None] Lock "cinder-5dfccf30-6cdd-4ef5-ad65-47138ceaf4f1-delete_snapshot" released by "delete_snapshot" :: held 3.440s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:43 devstack sudo[86514]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8 1073741824" returned: 0 in 0.724s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:43 devstack sudo[86522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8 Apr 27 10:09:43 devstack sudo[86522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d114d080-d70e-4a7c-be58-bc26a3768497 tempest-SnapshotsActionsTest-1847495719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:44 devstack sudo[86522]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8" returned: 0 in 0.519s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:44 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:09:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d114d080-d70e-4a7c-be58-bc26a3768497 tempest-SnapshotsActionsTest-1847495719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.127s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f43b7fa5-18ee-4a82-880b-b43597a2636b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be8a2475-d68d-4d45-b74d-95030da59fd8', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28ac35a-76d5-4f0e-a637-86f5d69d7426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:44 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-d114d080-d70e-4a7c-be58-bc26a3768497 tempest-SnapshotsActionsTest-1847495719 None] Creating offline snapshot e9485554-d7d1-4f21-9d79-a30faee087fa of volume 01b7daeb-5dd1-40f5-ba81-36b302279142 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:09:44 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Volume volume-be8a2475-d68d-4d45-b74d-95030da59fd8 (be8a2475-d68d-4d45-b74d-95030da59fd8): created successfully Apr 27 10:09:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28ac35a-76d5-4f0e-a637-86f5d69d7426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Flow 'volume_create_manager' (af3608a1-a1c8-49df-9e79-21046214fa70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:09:44 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d50d071-0963-49a2-b02c-f6a9f7b76776]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d114d080-d70e-4a7c-be58-bc26a3768497 tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:44 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-594c731a-3b0c-4823-a08a-4fcff82bf031 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Created volume successfully. Apr 27 10:09:44 devstack sudo[86525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b Apr 27 10:09:44 devstack sudo[86525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:45 devstack sudo[86525]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d114d080-d70e-4a7c-be58-bc26a3768497 tempest-SnapshotsActionsTest-1847495719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b" returned: 0 in 0.650s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:45 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-d114d080-d70e-4a7c-be58-bc26a3768497 tempest-SnapshotsActionsTest-1847495719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01b7daeb-5dd1-40f5-ba81-36b302279142(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:09:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d114d080-d70e-4a7c-be58-bc26a3768497 tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.e9485554-d7d1-4f21-9d79-a30faee087fa 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:45 devstack sudo[86531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.e9485554-d7d1-4f21-9d79-a30faee087fa 1G Apr 27 10:09:45 devstack sudo[86531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d1a652bb-c80b-4395-b266-bd7a687150a0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:45 devstack sudo[86531]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d114d080-d70e-4a7c-be58-bc26a3768497 tempest-SnapshotsActionsTest-1847495719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.e9485554-d7d1-4f21-9d79-a30faee087fa 1G" returned: 0 in 0.920s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d114d080-d70e-4a7c-be58-bc26a3768497 tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.e9485554-d7d1-4f21-9d79-a30faee087fa {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:45 devstack sudo[86544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.e9485554-d7d1-4f21-9d79-a30faee087fa Apr 27 10:09:45 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:46 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d114d080-d70e-4a7c-be58-bc26a3768497 tempest-SnapshotsActionsTest-1847495719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.e9485554-d7d1-4f21-9d79-a30faee087fa" returned: 0 in 0.630s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:46 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-d114d080-d70e-4a7c-be58-bc26a3768497 tempest-SnapshotsActionsTest-1847495719 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.e9485554-d7d1-4f21-9d79-a30faee087fa is being set with open permissions: ugo+rw Apr 27 10:09:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d114d080-d70e-4a7c-be58-bc26a3768497 tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.e9485554-d7d1-4f21-9d79-a30faee087fa {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:46 devstack sudo[86556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.e9485554-d7d1-4f21-9d79-a30faee087fa Apr 27 10:09:46 devstack sudo[86556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:47 devstack sudo[86556]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d114d080-d70e-4a7c-be58-bc26a3768497 tempest-SnapshotsActionsTest-1847495719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.e9485554-d7d1-4f21-9d79-a30faee087fa" returned: 0 in 0.763s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d114d080-d70e-4a7c-be58-bc26a3768497 tempest-SnapshotsActionsTest-1847495719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.118s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d1a652bb-c80b-4395-b266-bd7a687150a0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.305s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:47 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-d1a652bb-c80b-4395-b266-bd7a687150a0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Creating offline snapshot 7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75 of volume be8a2475-d68d-4d45-b74d-95030da59fd8 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:09:47 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b9fae6-ebed-455c-a755-76750b8aead0]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d1a652bb-c80b-4395-b266-bd7a687150a0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:47 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-d114d080-d70e-4a7c-be58-bc26a3768497 tempest-SnapshotsActionsTest-1847495719 None] Create snapshot completed successfully Apr 27 10:09:47 devstack sudo[86587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8 Apr 27 10:09:47 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:48 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d1a652bb-c80b-4395-b266-bd7a687150a0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8" returned: 0 in 0.697s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d1a652bb-c80b-4395-b266-bd7a687150a0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:48 devstack sudo[86594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75 1G Apr 27 10:09:48 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bc6e8506-4fd0-4406-8aec-1d4cffacacfe tempest-SnapshotsActionsTest-1756105371 None] Acquiring lock "cinder-e9485554-d7d1-4f21-9d79-a30faee087fa-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bc6e8506-4fd0-4406-8aec-1d4cffacacfe tempest-SnapshotsActionsTest-1756105371 None] Lock "cinder-e9485554-d7d1-4f21-9d79-a30faee087fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bc6e8506-4fd0-4406-8aec-1d4cffacacfe tempest-SnapshotsActionsTest-1756105371 None] Acquiring lock "cinder-quobyte-01b7daeb-5dd1-40f5-ba81-36b302279142" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bc6e8506-4fd0-4406-8aec-1d4cffacacfe tempest-SnapshotsActionsTest-1756105371 None] Lock "cinder-quobyte-01b7daeb-5dd1-40f5-ba81-36b302279142" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bc6e8506-4fd0-4406-8aec-1d4cffacacfe tempest-SnapshotsActionsTest-1756105371 None] Acquiring lock "cinder-quobyte-e9485554-d7d1-4f21-9d79-a30faee087fa" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:09:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bc6e8506-4fd0-4406-8aec-1d4cffacacfe tempest-SnapshotsActionsTest-1756105371 None] Lock "cinder-quobyte-e9485554-d7d1-4f21-9d79-a30faee087fa" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:09:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-bc6e8506-4fd0-4406-8aec-1d4cffacacfe tempest-SnapshotsActionsTest-1756105371 None] Deleting offline snapshot e9485554-d7d1-4f21-9d79-a30faee087fa of volume 01b7daeb-5dd1-40f5-ba81-36b302279142 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:09:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-bc6e8506-4fd0-4406-8aec-1d4cffacacfe tempest-SnapshotsActionsTest-1756105371 None] snapshot_file for this snap is: volume-01b7daeb-5dd1-40f5-ba81-36b302279142.e9485554-d7d1-4f21-9d79-a30faee087fa {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:09:48 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c548ca-f3c7-4f21-9134-1d5c4da3db21]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bc6e8506-4fd0-4406-8aec-1d4cffacacfe tempest-SnapshotsActionsTest-1756105371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.e9485554-d7d1-4f21-9d79-a30faee087fa {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:48 devstack sudo[86596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.e9485554-d7d1-4f21-9d79-a30faee087fa Apr 27 10:09:48 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:49 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d1a652bb-c80b-4395-b266-bd7a687150a0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75 1G" returned: 0 in 1.050s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d1a652bb-c80b-4395-b266-bd7a687150a0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be8a2475-d68d-4d45-b74d-95030da59fd8 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:49 devstack sudo[86602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be8a2475-d68d-4d45-b74d-95030da59fd8 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75 Apr 27 10:09:49 devstack sudo[86602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:49 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bc6e8506-4fd0-4406-8aec-1d4cffacacfe tempest-SnapshotsActionsTest-1756105371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.e9485554-d7d1-4f21-9d79-a30faee087fa" returned: 0 in 1.106s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:49 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-bc6e8506-4fd0-4406-8aec-1d4cffacacfe tempest-SnapshotsActionsTest-1756105371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01b7daeb-5dd1-40f5-ba81-36b302279142(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:09:49 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e178f360-fb39-42d3-b1de-36e26fb57659]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bc6e8506-4fd0-4406-8aec-1d4cffacacfe tempest-SnapshotsActionsTest-1756105371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:49 devstack sudo[86608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b Apr 27 10:09:49 devstack sudo[86608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:49 devstack sudo[86602]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d1a652bb-c80b-4395-b266-bd7a687150a0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be8a2475-d68d-4d45-b74d-95030da59fd8 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75" returned: 0 in 0.784s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:50 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-d1a652bb-c80b-4395-b266-bd7a687150a0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75 is being set with open permissions: ugo+rw Apr 27 10:09:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d1a652bb-c80b-4395-b266-bd7a687150a0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:50 devstack sudo[86612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75 Apr 27 10:09:50 devstack sudo[86612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:50 devstack sudo[86608]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bc6e8506-4fd0-4406-8aec-1d4cffacacfe tempest-SnapshotsActionsTest-1756105371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b" returned: 0 in 1.079s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:50 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-bc6e8506-4fd0-4406-8aec-1d4cffacacfe tempest-SnapshotsActionsTest-1756105371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01b7daeb-5dd1-40f5-ba81-36b302279142(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:09:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bc6e8506-4fd0-4406-8aec-1d4cffacacfe tempest-SnapshotsActionsTest-1756105371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.e9485554-d7d1-4f21-9d79-a30faee087fa {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:50 devstack sudo[86618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.e9485554-d7d1-4f21-9d79-a30faee087fa Apr 27 10:09:50 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:50 devstack sudo[86612]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d1a652bb-c80b-4395-b266-bd7a687150a0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75" returned: 0 in 0.984s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d1a652bb-c80b-4395-b266-bd7a687150a0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:51 devstack sudo[86620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.info Apr 27 10:09:51 devstack sudo[86620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:51 devstack sudo[86620]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d1a652bb-c80b-4395-b266-bd7a687150a0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.info" returned: 0 in 0.863s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:51 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-d1a652bb-c80b-4395-b266-bd7a687150a0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.info is being set with open permissions: ugo+rw Apr 27 10:09:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d1a652bb-c80b-4395-b266-bd7a687150a0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:52 devstack sudo[86626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.info Apr 27 10:09:52 devstack sudo[86626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:52 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bc6e8506-4fd0-4406-8aec-1d4cffacacfe tempest-SnapshotsActionsTest-1756105371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.e9485554-d7d1-4f21-9d79-a30faee087fa" returned: 0 in 1.290s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bc6e8506-4fd0-4406-8aec-1d4cffacacfe tempest-SnapshotsActionsTest-1756105371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.e9485554-d7d1-4f21-9d79-a30faee087fa {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:52 devstack sudo[86628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.e9485554-d7d1-4f21-9d79-a30faee087fa Apr 27 10:09:52 devstack sudo[86628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:52 devstack sudo[86626]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d1a652bb-c80b-4395-b266-bd7a687150a0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.info" returned: 0 in 0.947s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d1a652bb-c80b-4395-b266-bd7a687150a0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.453s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:52 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-d1a652bb-c80b-4395-b266-bd7a687150a0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Create snapshot completed successfully Apr 27 10:09:53 devstack sudo[86628]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bc6e8506-4fd0-4406-8aec-1d4cffacacfe tempest-SnapshotsActionsTest-1756105371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.e9485554-d7d1-4f21-9d79-a30faee087fa" returned: 0 in 0.821s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:53 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bc6e8506-4fd0-4406-8aec-1d4cffacacfe tempest-SnapshotsActionsTest-1756105371 None] Lock "cinder-quobyte-e9485554-d7d1-4f21-9d79-a30faee087fa" released by "_delete_snapshot" :: held 4.445s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:53 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bc6e8506-4fd0-4406-8aec-1d4cffacacfe tempest-SnapshotsActionsTest-1756105371 None] Lock "cinder-quobyte-01b7daeb-5dd1-40f5-ba81-36b302279142" released by "delete_snapshot" :: held 4.466s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:53 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-bc6e8506-4fd0-4406-8aec-1d4cffacacfe tempest-SnapshotsActionsTest-1756105371 None] Created reservations ['16176330-0075-4d2f-b13f-d5a4c7301aff', '964eacdb-ec9d-4c0d-9ada-87cc45d50074', '738c3bb4-7fbe-4641-96b9-0f5c8d27884e', '84e460d5-734b-4f9f-b466-ed4d3a4b0e0c'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:09:53 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-bc6e8506-4fd0-4406-8aec-1d4cffacacfe tempest-SnapshotsActionsTest-1756105371 None] Delete snapshot completed successfully. Apr 27 10:09:53 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bc6e8506-4fd0-4406-8aec-1d4cffacacfe tempest-SnapshotsActionsTest-1756105371 None] Lock "cinder-e9485554-d7d1-4f21-9d79-a30faee087fa-delete_snapshot" released by "delete_snapshot" :: held 4.680s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:09:53 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:09:53 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Flow 'volume_create_manager' (c7c73d57-6ba7-4cbc-962e-527db6fb941c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:09:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (818fc5fa-56a8-4d99-8bab-6fba4a3d51c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (818fc5fa-56a8-4d99-8bab-6fba4a3d51c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1446725484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a48ae923-a3ea-429b-8e40-64ab45c8a60d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5be380481e4c83970a7af51231c0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:09:54Z,use_quota=True,user_id='1967be54001c40b09af362c32d730bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a609a03-470d-4bed-ab23-b3f4459fc2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a609a03-470d-4bed-ab23-b3f4459fc2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ca7a47-2ce9-4dcd-a613-12ec4988918c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ca7a47-2ce9-4dcd-a613-12ec4988918c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a48ae923-a3ea-429b-8e40-64ab45c8a60d', 'volume_name': 'volume-a48ae923-a3ea-429b-8e40-64ab45c8a60d', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b353226d-8cfa-46b4-b91d-3b92efc32d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b353226d-8cfa-46b4-b91d-3b92efc32d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff87b828-dea9-4069-8eed-f79eb0e48974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:54 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Volume a48ae923-a3ea-429b-8e40-64ab45c8a60d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a48ae923-a3ea-429b-8e40-64ab45c8a60d', 'volume_size': 1} Apr 27 10:09:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1446725484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a48ae923-a3ea-429b-8e40-64ab45c8a60d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5be380481e4c83970a7af51231c0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:09:54Z,use_quota=True,user_id='1967be54001c40b09af362c32d730bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:09:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Creating volume a48ae923-a3ea-429b-8e40-64ab45c8a60d {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:09:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:09:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:09:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:09:54 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:09:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a48ae923-a3ea-429b-8e40-64ab45c8a60d 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:54 devstack sudo[86633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a48ae923-a3ea-429b-8e40-64ab45c8a60d 1073741824 Apr 27 10:09:54 devstack sudo[86633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:54 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Flow 'volume_create_manager' (56483495-e9a7-4d1e-9278-a1689f050f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (250e9a79-c5b3-4a4a-870a-014c99263247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ee7629ca-3d52-4f79-a20b-424a8c15ba86 tempest-SnapshotsActionsTest-1847495719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (250e9a79-c5b3-4a4a-870a-014c99263247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-956823489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c36567f2-5242-478b-ae7e-03b55ad7f982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5be380481e4c83970a7af51231c0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:09:54Z,use_quota=True,user_id='1967be54001c40b09af362c32d730bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc229dd2-d165-4c1f-a578-f45e68b02cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc229dd2-d165-4c1f-a578-f45e68b02cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27b16c3-ee26-4c1a-872c-1a9be3b6ff38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27b16c3-ee26-4c1a-872c-1a9be3b6ff38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c36567f2-5242-478b-ae7e-03b55ad7f982', 'volume_name': 'volume-c36567f2-5242-478b-ae7e-03b55ad7f982', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1548b87-447f-40b6-a5ae-2531a826e497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1548b87-447f-40b6-a5ae-2531a826e497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ffba59f-ac5e-42a3-868f-2498a33fa783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:55 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Volume c36567f2-5242-478b-ae7e-03b55ad7f982: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c36567f2-5242-478b-ae7e-03b55ad7f982', 'volume_size': 1} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Flow 'volume_create_manager' (641e982a-1c16-48e7-b96d-e680b663f260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe88dfad-f0c2-4061-a34d-1e3fd8b67a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe88dfad-f0c2-4061-a34d-1e3fd8b67a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1107570096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a067ca48-e6d3-428b-b41a-fa4690bfd970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5be380481e4c83970a7af51231c0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:09:56Z,use_quota=True,user_id='1967be54001c40b09af362c32d730bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8280db82-7108-4efe-baea-bcfecf0f98d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8280db82-7108-4efe-baea-bcfecf0f98d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a017009-af70-4f6a-bbe3-372c3cc8bd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a017009-af70-4f6a-bbe3-372c3cc8bd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a067ca48-e6d3-428b-b41a-fa4690bfd970', 'volume_name': 'volume-a067ca48-e6d3-428b-b41a-fa4690bfd970', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714ed1cd-be6f-45d2-a570-90991dbbb710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714ed1cd-be6f-45d2-a570-90991dbbb710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25e2366-cc07-4f73-a0c5-c2abd25ad470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:55 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Volume a067ca48-e6d3-428b-b41a-fa4690bfd970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a067ca48-e6d3-428b-b41a-fa4690bfd970', 'volume_size': 1} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:55 devstack sudo[86633]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a48ae923-a3ea-429b-8e40-64ab45c8a60d 1073741824" returned: 0 in 1.636s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a48ae923-a3ea-429b-8e40-64ab45c8a60d {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:55 devstack sudo[86673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a48ae923-a3ea-429b-8e40-64ab45c8a60d Apr 27 10:09:55 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Flow 'volume_create_manager' (cdc60670-8c29-4eed-92ff-53d857d582a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4513b432-5f76-40bc-81b6-60f4716b00cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4513b432-5f76-40bc-81b6-60f4716b00cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1493495736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c3717c-8341-4ed2-adc8-9d43d73d9f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5be380481e4c83970a7af51231c0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:09:56Z,use_quota=True,user_id='1967be54001c40b09af362c32d730bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ca1c7c-481f-4c1e-ae7b-dbbefd2e3a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ca1c7c-481f-4c1e-ae7b-dbbefd2e3a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262df86f-ff4a-498d-8763-0a4e03c3d579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262df86f-ff4a-498d-8763-0a4e03c3d579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30c3717c-8341-4ed2-adc8-9d43d73d9f18', 'volume_name': 'volume-30c3717c-8341-4ed2-adc8-9d43d73d9f18', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d113112-b65e-4336-8749-182dd1bbad09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d113112-b65e-4336-8749-182dd1bbad09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99560853-1b66-4539-b9d1-1c1f9a483ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:56 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Volume 30c3717c-8341-4ed2-adc8-9d43d73d9f18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30c3717c-8341-4ed2-adc8-9d43d73d9f18', 'volume_size': 1} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Flow 'volume_create_manager' (920f18a3-107b-4462-9095-85e7058897e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d084c4b0-a718-43e6-a188-ede56a37daed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d084c4b0-a718-43e6-a188-ede56a37daed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1469501953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0466af4f-4288-4ff2-a6f5-f124ee03c1d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5be380481e4c83970a7af51231c0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:09:57Z,use_quota=True,user_id='1967be54001c40b09af362c32d730bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434f1b8b-ee57-4c3b-939f-15f113b94b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434f1b8b-ee57-4c3b-939f-15f113b94b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e26c6d8-3996-4f7f-9c0e-fca04fc52dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e26c6d8-3996-4f7f-9c0e-fca04fc52dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0466af4f-4288-4ff2-a6f5-f124ee03c1d3', 'volume_name': 'volume-0466af4f-4288-4ff2-a6f5-f124ee03c1d3', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aab99cd-854c-4fc9-9a35-87597c099350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aab99cd-854c-4fc9-9a35-87597c099350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f4d10c-2a88-4894-9363-86c8bab913a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:56 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Volume 0466af4f-4288-4ff2-a6f5-f124ee03c1d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0466af4f-4288-4ff2-a6f5-f124ee03c1d3', 'volume_size': 1} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:56 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a48ae923-a3ea-429b-8e40-64ab45c8a60d" returned: 0 in 1.013s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] <== create_volume: return (2735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.741s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ee7629ca-3d52-4f79-a20b-424a8c15ba86 tempest-SnapshotsActionsTest-1847495719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.849s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff87b828-dea9-4069-8eed-f79eb0e48974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a48ae923-a3ea-429b-8e40-64ab45c8a60d', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb9f434-5091-4378-827f-319f5d778f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:09:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-ee7629ca-3d52-4f79-a20b-424a8c15ba86 tempest-SnapshotsActionsTest-1847495719 None] Creating offline snapshot 12a39067-85a2-4640-a017-17e8d5c63528 of volume 01b7daeb-5dd1-40f5-ba81-36b302279142 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:09:57 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Volume volume-a48ae923-a3ea-429b-8e40-64ab45c8a60d (a48ae923-a3ea-429b-8e40-64ab45c8a60d): created successfully Apr 27 10:09:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb9f434-5091-4378-827f-319f5d778f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:09:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Flow 'volume_create_manager' (c7c73d57-6ba7-4cbc-962e-527db6fb941c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:09:57 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cd6c31-807d-4d03-b238-1b54c9b1a212]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:09:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ee7629ca-3d52-4f79-a20b-424a8c15ba86 tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:57 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-53728eb9-7dfb-4cc9-aadc-6ab87a0e586b tempest-CreateVolumesFromSnapshotTest-2051008310 None] Created volume successfully. Apr 27 10:09:57 devstack sudo[86682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b Apr 27 10:09:57 devstack sudo[86682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:57 devstack sudo[86682]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ee7629ca-3d52-4f79-a20b-424a8c15ba86 tempest-SnapshotsActionsTest-1847495719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b" returned: 0 in 0.696s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-ee7629ca-3d52-4f79-a20b-424a8c15ba86 tempest-SnapshotsActionsTest-1847495719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01b7daeb-5dd1-40f5-ba81-36b302279142(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:09:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ee7629ca-3d52-4f79-a20b-424a8c15ba86 tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.12a39067-85a2-4640-a017-17e8d5c63528 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:57 devstack sudo[86710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.12a39067-85a2-4640-a017-17e8d5c63528 1G Apr 27 10:09:57 devstack sudo[86710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:58 devstack sudo[86710]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ee7629ca-3d52-4f79-a20b-424a8c15ba86 tempest-SnapshotsActionsTest-1847495719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.12a39067-85a2-4640-a017-17e8d5c63528 1G" returned: 0 in 0.796s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ee7629ca-3d52-4f79-a20b-424a8c15ba86 tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.12a39067-85a2-4640-a017-17e8d5c63528 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:58 devstack sudo[86716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.12a39067-85a2-4640-a017-17e8d5c63528 Apr 27 10:09:58 devstack sudo[86716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:59 devstack sudo[86716]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ee7629ca-3d52-4f79-a20b-424a8c15ba86 tempest-SnapshotsActionsTest-1847495719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.12a39067-85a2-4640-a017-17e8d5c63528" returned: 0 in 0.698s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:59 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-ee7629ca-3d52-4f79-a20b-424a8c15ba86 tempest-SnapshotsActionsTest-1847495719 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.12a39067-85a2-4640-a017-17e8d5c63528 is being set with open permissions: ugo+rw Apr 27 10:09:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ee7629ca-3d52-4f79-a20b-424a8c15ba86 tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.12a39067-85a2-4640-a017-17e8d5c63528 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:59 devstack sudo[86722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.12a39067-85a2-4640-a017-17e8d5c63528 Apr 27 10:09:59 devstack sudo[86722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:59 devstack sudo[86722]: pam_unix(sudo:session): session closed for user root Apr 27 10:09:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ee7629ca-3d52-4f79-a20b-424a8c15ba86 tempest-SnapshotsActionsTest-1847495719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.12a39067-85a2-4640-a017-17e8d5c63528" returned: 0 in 0.574s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:09:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ee7629ca-3d52-4f79-a20b-424a8c15ba86 tempest-SnapshotsActionsTest-1847495719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.948s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.677s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-956823489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c36567f2-5242-478b-ae7e-03b55ad7f982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5be380481e4c83970a7af51231c0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:09:54Z,use_quota=True,user_id='1967be54001c40b09af362c32d730bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:09:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Creating volume c36567f2-5242-478b-ae7e-03b55ad7f982 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:09:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:09:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:09:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:09:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:09:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:09:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:09:59 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:09:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c36567f2-5242-478b-ae7e-03b55ad7f982 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:09:59 devstack sudo[86745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c36567f2-5242-478b-ae7e-03b55ad7f982 1073741824 Apr 27 10:09:59 devstack sudo[86745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:09:59 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-ee7629ca-3d52-4f79-a20b-424a8c15ba86 tempest-SnapshotsActionsTest-1847495719 None] Create snapshot completed successfully Apr 27 10:10:00 devstack sudo[86745]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c36567f2-5242-478b-ae7e-03b55ad7f982 1073741824" returned: 0 in 0.671s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c36567f2-5242-478b-ae7e-03b55ad7f982 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:00 devstack sudo[86750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c36567f2-5242-478b-ae7e-03b55ad7f982 Apr 27 10:10:00 devstack sudo[86750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e65f51fa-d7c6-4bd0-842e-c27e0ccc7b52 tempest-SnapshotsActionsTest-1756105371 None] Acquiring lock "cinder-12a39067-85a2-4640-a017-17e8d5c63528-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e65f51fa-d7c6-4bd0-842e-c27e0ccc7b52 tempest-SnapshotsActionsTest-1756105371 None] Lock "cinder-12a39067-85a2-4640-a017-17e8d5c63528-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e65f51fa-d7c6-4bd0-842e-c27e0ccc7b52 tempest-SnapshotsActionsTest-1756105371 None] Acquiring lock "cinder-quobyte-01b7daeb-5dd1-40f5-ba81-36b302279142" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:01 devstack sudo[86750]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c36567f2-5242-478b-ae7e-03b55ad7f982" returned: 0 in 0.585s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e65f51fa-d7c6-4bd0-842e-c27e0ccc7b52 tempest-SnapshotsActionsTest-1756105371 None] Lock "cinder-quobyte-01b7daeb-5dd1-40f5-ba81-36b302279142" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e65f51fa-d7c6-4bd0-842e-c27e0ccc7b52 tempest-SnapshotsActionsTest-1756105371 None] Acquiring lock "cinder-quobyte-12a39067-85a2-4640-a017-17e8d5c63528" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.379s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1107570096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a067ca48-e6d3-428b-b41a-fa4690bfd970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5be380481e4c83970a7af51231c0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:09:56Z,use_quota=True,user_id='1967be54001c40b09af362c32d730bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Creating volume a067ca48-e6d3-428b-b41a-fa4690bfd970 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:10:01 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a067ca48-e6d3-428b-b41a-fa4690bfd970 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ffba59f-ac5e-42a3-868f-2498a33fa783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c36567f2-5242-478b-ae7e-03b55ad7f982', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:01 devstack sudo[86753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a067ca48-e6d3-428b-b41a-fa4690bfd970 1073741824 Apr 27 10:10:01 devstack sudo[86753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5382d620-b08f-4a8a-860a-0f03a58cc1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e65f51fa-d7c6-4bd0-842e-c27e0ccc7b52 tempest-SnapshotsActionsTest-1756105371 None] Lock "cinder-quobyte-12a39067-85a2-4640-a017-17e8d5c63528" acquired by "_delete_snapshot" :: waited 0.061s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-e65f51fa-d7c6-4bd0-842e-c27e0ccc7b52 tempest-SnapshotsActionsTest-1756105371 None] Deleting offline snapshot 12a39067-85a2-4640-a017-17e8d5c63528 of volume 01b7daeb-5dd1-40f5-ba81-36b302279142 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-e65f51fa-d7c6-4bd0-842e-c27e0ccc7b52 tempest-SnapshotsActionsTest-1756105371 None] snapshot_file for this snap is: volume-01b7daeb-5dd1-40f5-ba81-36b302279142.12a39067-85a2-4640-a017-17e8d5c63528 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f797f02-46c9-46c5-ba80-d7dd0c331cfd]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e65f51fa-d7c6-4bd0-842e-c27e0ccc7b52 tempest-SnapshotsActionsTest-1756105371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.12a39067-85a2-4640-a017-17e8d5c63528 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:01 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Volume volume-c36567f2-5242-478b-ae7e-03b55ad7f982 (c36567f2-5242-478b-ae7e-03b55ad7f982): created successfully Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5382d620-b08f-4a8a-860a-0f03a58cc1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:01 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Flow 'volume_create_manager' (56483495-e9a7-4d1e-9278-a1689f050f56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:10:01 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-8e00dc15-e485-4d66-9718-2a54b8ede7d8 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Created volume successfully. Apr 27 10:10:01 devstack sudo[86755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.12a39067-85a2-4640-a017-17e8d5c63528 Apr 27 10:10:01 devstack sudo[86755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:02 devstack sudo[86755]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e65f51fa-d7c6-4bd0-842e-c27e0ccc7b52 tempest-SnapshotsActionsTest-1756105371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.12a39067-85a2-4640-a017-17e8d5c63528" returned: 0 in 0.717s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-e65f51fa-d7c6-4bd0-842e-c27e0ccc7b52 tempest-SnapshotsActionsTest-1756105371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01b7daeb-5dd1-40f5-ba81-36b302279142(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:10:02 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd274106-d7e4-4d9d-9fa1-6f5009a9c8f7]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:10:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e65f51fa-d7c6-4bd0-842e-c27e0ccc7b52 tempest-SnapshotsActionsTest-1756105371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:02 devstack sudo[86753]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a067ca48-e6d3-428b-b41a-fa4690bfd970 1073741824" returned: 0 in 0.933s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a067ca48-e6d3-428b-b41a-fa4690bfd970 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:02 devstack sudo[86764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b Apr 27 10:10:02 devstack sudo[86764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:02 devstack sudo[86765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a067ca48-e6d3-428b-b41a-fa4690bfd970 Apr 27 10:10:02 devstack sudo[86765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:02 devstack sudo[86764]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e65f51fa-d7c6-4bd0-842e-c27e0ccc7b52 tempest-SnapshotsActionsTest-1756105371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b" returned: 0 in 0.733s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-e65f51fa-d7c6-4bd0-842e-c27e0ccc7b52 tempest-SnapshotsActionsTest-1756105371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01b7daeb-5dd1-40f5-ba81-36b302279142(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:10:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e65f51fa-d7c6-4bd0-842e-c27e0ccc7b52 tempest-SnapshotsActionsTest-1756105371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.12a39067-85a2-4640-a017-17e8d5c63528 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:02 devstack sudo[86774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.12a39067-85a2-4640-a017-17e8d5c63528 Apr 27 10:10:02 devstack sudo[86774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:02 devstack sudo[86765]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a067ca48-e6d3-428b-b41a-fa4690bfd970" returned: 0 in 0.791s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:10:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.748s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1493495736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c3717c-8341-4ed2-adc8-9d43d73d9f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5be380481e4c83970a7af51231c0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:09:56Z,use_quota=True,user_id='1967be54001c40b09af362c32d730bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:10:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Creating volume 30c3717c-8341-4ed2-adc8-9d43d73d9f18 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:10:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:10:03 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:10:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-30c3717c-8341-4ed2-adc8-9d43d73d9f18 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25e2366-cc07-4f73-a0c5-c2abd25ad470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a067ca48-e6d3-428b-b41a-fa4690bfd970', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a0794e-2a46-40d0-bb9b-c0bf44b2bce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:03 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Volume volume-a067ca48-e6d3-428b-b41a-fa4690bfd970 (a067ca48-e6d3-428b-b41a-fa4690bfd970): created successfully Apr 27 10:10:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a0794e-2a46-40d0-bb9b-c0bf44b2bce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Flow 'volume_create_manager' (641e982a-1c16-48e7-b96d-e680b663f260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:10:03 devstack sudo[86776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-30c3717c-8341-4ed2-adc8-9d43d73d9f18 1073741824 Apr 27 10:10:03 devstack sudo[86776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:03 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-39440a0b-a5b4-429d-a046-7c71f15db0ff tempest-CreateVolumesFromSnapshotTest-2051008310 None] Created volume successfully. Apr 27 10:10:03 devstack sudo[86774]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e65f51fa-d7c6-4bd0-842e-c27e0ccc7b52 tempest-SnapshotsActionsTest-1756105371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.12a39067-85a2-4640-a017-17e8d5c63528" returned: 0 in 0.866s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e65f51fa-d7c6-4bd0-842e-c27e0ccc7b52 tempest-SnapshotsActionsTest-1756105371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.12a39067-85a2-4640-a017-17e8d5c63528 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:03 devstack sudo[86790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.12a39067-85a2-4640-a017-17e8d5c63528 Apr 27 10:10:03 devstack sudo[86790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:04 devstack sudo[86776]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-30c3717c-8341-4ed2-adc8-9d43d73d9f18 1073741824" returned: 0 in 1.067s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-30c3717c-8341-4ed2-adc8-9d43d73d9f18 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:04 devstack sudo[86798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-30c3717c-8341-4ed2-adc8-9d43d73d9f18 Apr 27 10:10:04 devstack sudo[86798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:04 devstack sudo[86790]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e65f51fa-d7c6-4bd0-842e-c27e0ccc7b52 tempest-SnapshotsActionsTest-1756105371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.12a39067-85a2-4640-a017-17e8d5c63528" returned: 0 in 0.744s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:04 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e65f51fa-d7c6-4bd0-842e-c27e0ccc7b52 tempest-SnapshotsActionsTest-1756105371 None] Lock "cinder-quobyte-12a39067-85a2-4640-a017-17e8d5c63528" released by "_delete_snapshot" :: held 3.181s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:04 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e65f51fa-d7c6-4bd0-842e-c27e0ccc7b52 tempest-SnapshotsActionsTest-1756105371 None] Lock "cinder-quobyte-01b7daeb-5dd1-40f5-ba81-36b302279142" released by "delete_snapshot" :: held 3.263s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:04 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-e65f51fa-d7c6-4bd0-842e-c27e0ccc7b52 tempest-SnapshotsActionsTest-1756105371 None] Created reservations ['1667b8eb-be6e-4ca2-8a73-4fea4d0b1e84', '5d064019-5777-40d9-8fa9-e4487291e3c5', '2a8456f9-4050-44c2-9947-fa3623a2e0b5', '20757b45-2242-41c9-b941-08d6cc9c5457'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:10:04 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-e65f51fa-d7c6-4bd0-842e-c27e0ccc7b52 tempest-SnapshotsActionsTest-1756105371 None] Delete snapshot completed successfully. Apr 27 10:10:04 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e65f51fa-d7c6-4bd0-842e-c27e0ccc7b52 tempest-SnapshotsActionsTest-1756105371 None] Lock "cinder-12a39067-85a2-4640-a017-17e8d5c63528-delete_snapshot" released by "delete_snapshot" :: held 3.439s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:04 devstack sudo[86798]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-30c3717c-8341-4ed2-adc8-9d43d73d9f18" returned: 0 in 0.732s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:04 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] <== create_volume: return (1886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:10:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.003s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:04 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1469501953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0466af4f-4288-4ff2-a6f5-f124ee03c1d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5be380481e4c83970a7af51231c0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:09:57Z,use_quota=True,user_id='1967be54001c40b09af362c32d730bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:10:04 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Creating volume 0466af4f-4288-4ff2-a6f5-f124ee03c1d3 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:10:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:04 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:04 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:04 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:10:04 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:10:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0466af4f-4288-4ff2-a6f5-f124ee03c1d3 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:04 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99560853-1b66-4539-b9d1-1c1f9a483ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30c3717c-8341-4ed2-adc8-9d43d73d9f18', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:04 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ddc8e94-b01f-4086-af50-ec3e563a19c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:04 devstack sudo[86814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0466af4f-4288-4ff2-a6f5-f124ee03c1d3 1073741824 Apr 27 10:10:04 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:04 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Volume volume-30c3717c-8341-4ed2-adc8-9d43d73d9f18 (30c3717c-8341-4ed2-adc8-9d43d73d9f18): created successfully Apr 27 10:10:04 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ddc8e94-b01f-4086-af50-ec3e563a19c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:04 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Flow 'volume_create_manager' (cdc60670-8c29-4eed-92ff-53d857d582a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:10:05 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-57f4b503-11e2-45d9-9377-d7084647f032 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Created volume successfully. Apr 27 10:10:06 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0466af4f-4288-4ff2-a6f5-f124ee03c1d3 1073741824" returned: 0 in 1.147s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0466af4f-4288-4ff2-a6f5-f124ee03c1d3 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:06 devstack sudo[86864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0466af4f-4288-4ff2-a6f5-f124ee03c1d3 Apr 27 10:10:06 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5764a05e-701d-40f5-aed8-af266a98fdda tempest-SnapshotsActionsTest-1847495719 None] Acquiring lock "cinder-5305d55c-b50a-460a-bbe0-cfc4b478c82b-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5764a05e-701d-40f5-aed8-af266a98fdda tempest-SnapshotsActionsTest-1847495719 None] Lock "cinder-5305d55c-b50a-460a-bbe0-cfc4b478c82b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5764a05e-701d-40f5-aed8-af266a98fdda tempest-SnapshotsActionsTest-1847495719 None] Acquiring lock "cinder-quobyte-01b7daeb-5dd1-40f5-ba81-36b302279142" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5764a05e-701d-40f5-aed8-af266a98fdda tempest-SnapshotsActionsTest-1847495719 None] Lock "cinder-quobyte-01b7daeb-5dd1-40f5-ba81-36b302279142" acquired by "delete_snapshot" :: waited 0.033s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5764a05e-701d-40f5-aed8-af266a98fdda tempest-SnapshotsActionsTest-1847495719 None] Acquiring lock "cinder-quobyte-5305d55c-b50a-460a-bbe0-cfc4b478c82b" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5764a05e-701d-40f5-aed8-af266a98fdda tempest-SnapshotsActionsTest-1847495719 None] Lock "cinder-quobyte-5305d55c-b50a-460a-bbe0-cfc4b478c82b" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:06 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-5764a05e-701d-40f5-aed8-af266a98fdda tempest-SnapshotsActionsTest-1847495719 None] Deleting offline snapshot 5305d55c-b50a-460a-bbe0-cfc4b478c82b of volume 01b7daeb-5dd1-40f5-ba81-36b302279142 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:10:06 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-5764a05e-701d-40f5-aed8-af266a98fdda tempest-SnapshotsActionsTest-1847495719 None] snapshot_file for this snap is: volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:10:06 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[43455b82-7392-453c-b27b-e33414ad57e5]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:10:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5764a05e-701d-40f5-aed8-af266a98fdda tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:06 devstack sudo[86868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b Apr 27 10:10:06 devstack sudo[86868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:06 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0466af4f-4288-4ff2-a6f5-f124ee03c1d3" returned: 0 in 0.601s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:06 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:10:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f4d10c-2a88-4894-9363-86c8bab913a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0466af4f-4288-4ff2-a6f5-f124ee03c1d3', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da368669-3778-497b-8d4c-cb8671521e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:06 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Volume volume-0466af4f-4288-4ff2-a6f5-f124ee03c1d3 (0466af4f-4288-4ff2-a6f5-f124ee03c1d3): created successfully Apr 27 10:10:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da368669-3778-497b-8d4c-cb8671521e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Flow 'volume_create_manager' (920f18a3-107b-4462-9095-85e7058897e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:10:06 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-fb514008-3acf-4083-9c39-a8a4785e56b3 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Created volume successfully. Apr 27 10:10:07 devstack sudo[86868]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5764a05e-701d-40f5-aed8-af266a98fdda tempest-SnapshotsActionsTest-1847495719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b" returned: 0 in 0.980s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-5764a05e-701d-40f5-aed8-af266a98fdda tempest-SnapshotsActionsTest-1847495719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01b7daeb-5dd1-40f5-ba81-36b302279142(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b03102-55d6-457a-833c-9ef741505265]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5764a05e-701d-40f5-aed8-af266a98fdda tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Flow 'volume_create_manager' (3c3c5f22-8259-4fb4-a292-e2ed5b58d885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d917c329-484e-4ad3-bff3-5e4839730e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:07 devstack sudo[86875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142 Apr 27 10:10:07 devstack sudo[86875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d917c329-484e-4ad3-bff3-5e4839730e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-327881043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad382ce3-d94a-434d-9a6c-13957956a23b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de8c651a66d347a5a5b3489b912ad080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:10:07Z,use_quota=True,user_id='0b994bed7af9457a8e27e8e252991128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1373e8d4-cbc2-4e83-8f2b-85a9148f920a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1373e8d4-cbc2-4e83-8f2b-85a9148f920a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b6673c-cc7e-4057-bf3f-656cb767ea7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b6673c-cc7e-4057-bf3f-656cb767ea7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad382ce3-d94a-434d-9a6c-13957956a23b', 'volume_name': 'volume-ad382ce3-d94a-434d-9a6c-13957956a23b', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da11fb77-33a2-4e95-9afe-5f203133e44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da11fb77-33a2-4e95-9afe-5f203133e44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5a7cfd-de6a-49a5-8818-37e2a02ecda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:07 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Volume ad382ce3-d94a-434d-9a6c-13957956a23b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad382ce3-d94a-434d-9a6c-13957956a23b', 'volume_size': 1} Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-327881043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad382ce3-d94a-434d-9a6c-13957956a23b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de8c651a66d347a5a5b3489b912ad080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:10:07Z,use_quota=True,user_id='0b994bed7af9457a8e27e8e252991128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Creating volume ad382ce3-d94a-434d-9a6c-13957956a23b {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:10:07 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:10:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:07 devstack sudo[86877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b 1073741824 Apr 27 10:10:07 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-eaf35ae9-d94a-4724-9321-19e44931d9cd tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "cinder-0466af4f-4288-4ff2-a6f5-f124ee03c1d3-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-eaf35ae9-d94a-4724-9321-19e44931d9cd tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-0466af4f-4288-4ff2-a6f5-f124ee03c1d3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-eaf35ae9-d94a-4724-9321-19e44931d9cd tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "cinder-quobyte-0466af4f-4288-4ff2-a6f5-f124ee03c1d3" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-eaf35ae9-d94a-4724-9321-19e44931d9cd tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-quobyte-0466af4f-4288-4ff2-a6f5-f124ee03c1d3" acquired by "delete_volume" :: waited 0.027s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:08 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d35adb1-ea32-4b1f-9197-79580c2f3a62]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:10:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-eaf35ae9-d94a-4724-9321-19e44931d9cd tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0466af4f-4288-4ff2-a6f5-f124ee03c1d3 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:08 devstack sudo[86882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0466af4f-4288-4ff2-a6f5-f124ee03c1d3 Apr 27 10:10:08 devstack sudo[86882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:08 devstack sudo[86875]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5764a05e-701d-40f5-aed8-af266a98fdda tempest-SnapshotsActionsTest-1847495719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142" returned: 0 in 1.089s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5764a05e-701d-40f5-aed8-af266a98fdda tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:08 devstack sudo[86888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b Apr 27 10:10:08 devstack sudo[86888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:08 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b 1073741824" returned: 0 in 1.176s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:08 devstack sudo[86892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b Apr 27 10:10:08 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:09 devstack sudo[86882]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-eaf35ae9-d94a-4724-9321-19e44931d9cd tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0466af4f-4288-4ff2-a6f5-f124ee03c1d3" returned: 0 in 0.813s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-eaf35ae9-d94a-4724-9321-19e44931d9cd tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0466af4f-4288-4ff2-a6f5-f124ee03c1d3 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:09 devstack sudo[86895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0466af4f-4288-4ff2-a6f5-f124ee03c1d3 Apr 27 10:10:09 devstack sudo[86895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:09 devstack sudo[86888]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5764a05e-701d-40f5-aed8-af266a98fdda tempest-SnapshotsActionsTest-1847495719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b" returned: 0 in 0.923s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5764a05e-701d-40f5-aed8-af266a98fdda tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:09 devstack sudo[86901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b Apr 27 10:10:09 devstack sudo[86901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:09 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b" returned: 0 in 0.827s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:09 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] <== create_volume: return (2050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:10:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:09 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5a7cfd-de6a-49a5-8818-37e2a02ecda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad382ce3-d94a-434d-9a6c-13957956a23b', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:09 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b099f9-1cd1-47f1-b7e5-8a8af2ffba49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:09 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Volume volume-ad382ce3-d94a-434d-9a6c-13957956a23b (ad382ce3-d94a-434d-9a6c-13957956a23b): created successfully Apr 27 10:10:09 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b099f9-1cd1-47f1-b7e5-8a8af2ffba49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:09 devstack sudo[86895]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:09 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Flow 'volume_create_manager' (3c3c5f22-8259-4fb4-a292-e2ed5b58d885) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:10:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-eaf35ae9-d94a-4724-9321-19e44931d9cd tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0466af4f-4288-4ff2-a6f5-f124ee03c1d3" returned: 0 in 0.741s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:09 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-f0e024fa-26fd-44b5-96f6-d072ea1ef4c6 tempest-VolumesActionsTest-1292551954 None] Created volume successfully. Apr 27 10:10:09 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-eaf35ae9-d94a-4724-9321-19e44931d9cd tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-quobyte-0466af4f-4288-4ff2-a6f5-f124ee03c1d3" released by "delete_volume" :: held 1.632s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:09 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-eaf35ae9-d94a-4724-9321-19e44931d9cd tempest-CreateVolumesFromSnapshotTest-2051008310 None] Created reservations ['dd649964-5432-43b3-a9c6-cc0ffef1ca6c', '2d759779-bc1d-4d58-9666-b92c3befc224', 'ef1b4701-1f8b-40a2-be68-3c929b188ab0', '5f3e9103-c2df-4f5c-a7f9-c0de3f1c316f'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:10:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-eaf35ae9-d94a-4724-9321-19e44931d9cd tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-eaf35ae9-d94a-4724-9321-19e44931d9cd tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:09 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-eaf35ae9-d94a-4724-9321-19e44931d9cd tempest-CreateVolumesFromSnapshotTest-2051008310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:09 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-eaf35ae9-d94a-4724-9321-19e44931d9cd tempest-CreateVolumesFromSnapshotTest-2051008310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-eaf35ae9-d94a-4724-9321-19e44931d9cd tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-eaf35ae9-d94a-4724-9321-19e44931d9cd tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:10 devstack sudo[86904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:10:10 devstack sudo[86904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:10 devstack sudo[86901]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5764a05e-701d-40f5-aed8-af266a98fdda tempest-SnapshotsActionsTest-1847495719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142.5305d55c-b50a-460a-bbe0-cfc4b478c82b" returned: 0 in 0.680s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5764a05e-701d-40f5-aed8-af266a98fdda tempest-SnapshotsActionsTest-1847495719 None] Lock "cinder-quobyte-5305d55c-b50a-460a-bbe0-cfc4b478c82b" released by "_delete_snapshot" :: held 3.878s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5764a05e-701d-40f5-aed8-af266a98fdda tempest-SnapshotsActionsTest-1847495719 None] Lock "cinder-quobyte-01b7daeb-5dd1-40f5-ba81-36b302279142" released by "delete_snapshot" :: held 3.917s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:10 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-5764a05e-701d-40f5-aed8-af266a98fdda tempest-SnapshotsActionsTest-1847495719 None] Created reservations ['f59af463-15cd-4b18-ab88-97c64da916c5', 'afd3cfe5-d9c3-4275-a247-3884fe6aed29', '18cc6555-d750-4370-9012-afd6f6662257', 'f0aa7e6e-486d-46c6-9c9e-7550e36be4e4'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:10:10 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-5764a05e-701d-40f5-aed8-af266a98fdda tempest-SnapshotsActionsTest-1847495719 None] Delete snapshot completed successfully. Apr 27 10:10:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5764a05e-701d-40f5-aed8-af266a98fdda tempest-SnapshotsActionsTest-1847495719 None] Lock "cinder-5305d55c-b50a-460a-bbe0-cfc4b478c82b-delete_snapshot" released by "delete_snapshot" :: held 4.075s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-cf1a70ba-edf5-46d7-8068-b40847277dad tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "cinder-30c3717c-8341-4ed2-adc8-9d43d73d9f18-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-cf1a70ba-edf5-46d7-8068-b40847277dad tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-30c3717c-8341-4ed2-adc8-9d43d73d9f18-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-cf1a70ba-edf5-46d7-8068-b40847277dad tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "cinder-quobyte-30c3717c-8341-4ed2-adc8-9d43d73d9f18" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-cf1a70ba-edf5-46d7-8068-b40847277dad tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-quobyte-30c3717c-8341-4ed2-adc8-9d43d73d9f18" acquired by "delete_volume" :: waited 0.020s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:10 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7af4828-6818-4cbd-bfee-cc64fb1828f7]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:10:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cf1a70ba-edf5-46d7-8068-b40847277dad tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-30c3717c-8341-4ed2-adc8-9d43d73d9f18 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:10 devstack sudo[86904]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-eaf35ae9-d94a-4724-9321-19e44931d9cd tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.541s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:10 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-eaf35ae9-d94a-4724-9321-19e44931d9cd tempest-CreateVolumesFromSnapshotTest-2051008310 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:10:10 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-eaf35ae9-d94a-4724-9321-19e44931d9cd tempest-CreateVolumesFromSnapshotTest-2051008310 None] Deleted volume successfully. Apr 27 10:10:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-eaf35ae9-d94a-4724-9321-19e44931d9cd tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-0466af4f-4288-4ff2-a6f5-f124ee03c1d3-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:10 devstack sudo[86908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-30c3717c-8341-4ed2-adc8-9d43d73d9f18 Apr 27 10:10:10 devstack sudo[86908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ad0520de-c7bc-439c-8ecc-634955a7a3bc tempest-SnapshotsActionsTest-1847495719 None] Acquiring lock "cinder-01b7daeb-5dd1-40f5-ba81-36b302279142-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ad0520de-c7bc-439c-8ecc-634955a7a3bc tempest-SnapshotsActionsTest-1847495719 None] Lock "cinder-01b7daeb-5dd1-40f5-ba81-36b302279142-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ad0520de-c7bc-439c-8ecc-634955a7a3bc tempest-SnapshotsActionsTest-1847495719 None] Acquiring lock "cinder-quobyte-01b7daeb-5dd1-40f5-ba81-36b302279142" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ad0520de-c7bc-439c-8ecc-634955a7a3bc tempest-SnapshotsActionsTest-1847495719 None] Lock "cinder-quobyte-01b7daeb-5dd1-40f5-ba81-36b302279142" acquired by "delete_volume" :: waited 0.021s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:10 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b629f2-1aaf-4f3e-b7f0-55d0b66da452]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:10:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ad0520de-c7bc-439c-8ecc-634955a7a3bc tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:10 devstack sudo[86910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142 Apr 27 10:10:10 devstack sudo[86910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:11 devstack sudo[86908]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cf1a70ba-edf5-46d7-8068-b40847277dad tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-30c3717c-8341-4ed2-adc8-9d43d73d9f18" returned: 0 in 0.766s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cf1a70ba-edf5-46d7-8068-b40847277dad tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-30c3717c-8341-4ed2-adc8-9d43d73d9f18 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:11 devstack sudo[86924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-30c3717c-8341-4ed2-adc8-9d43d73d9f18 Apr 27 10:10:11 devstack sudo[86924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:11 devstack sudo[86910]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ad0520de-c7bc-439c-8ecc-634955a7a3bc tempest-SnapshotsActionsTest-1847495719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142" returned: 0 in 0.751s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ad0520de-c7bc-439c-8ecc-634955a7a3bc tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:11 devstack sudo[86946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142 Apr 27 10:10:11 devstack sudo[86946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:11 devstack sudo[86924]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cf1a70ba-edf5-46d7-8068-b40847277dad tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-30c3717c-8341-4ed2-adc8-9d43d73d9f18" returned: 0 in 0.673s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-cf1a70ba-edf5-46d7-8068-b40847277dad tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-quobyte-30c3717c-8341-4ed2-adc8-9d43d73d9f18" released by "delete_volume" :: held 1.491s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:12 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-cf1a70ba-edf5-46d7-8068-b40847277dad tempest-CreateVolumesFromSnapshotTest-2051008310 None] Created reservations ['adc566db-9b31-4f1a-be30-3ed42565dcbd', '5ea50c63-785b-4636-9ad7-597b4778f5d2', 'b4e116f0-4baf-4b2a-9c4f-bb1a264bb9fc', '27fa6ef9-4439-472a-8228-a74ef6f7e0c1'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:10:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-cf1a70ba-edf5-46d7-8068-b40847277dad tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-cf1a70ba-edf5-46d7-8068-b40847277dad tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:12 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-cf1a70ba-edf5-46d7-8068-b40847277dad tempest-CreateVolumesFromSnapshotTest-2051008310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:12 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-cf1a70ba-edf5-46d7-8068-b40847277dad tempest-CreateVolumesFromSnapshotTest-2051008310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-cf1a70ba-edf5-46d7-8068-b40847277dad tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cf1a70ba-edf5-46d7-8068-b40847277dad tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:12 devstack sudo[86953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:10:12 devstack sudo[86953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:12 devstack sudo[86946]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ad0520de-c7bc-439c-8ecc-634955a7a3bc tempest-SnapshotsActionsTest-1847495719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-01b7daeb-5dd1-40f5-ba81-36b302279142" returned: 0 in 0.734s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:12 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ad0520de-c7bc-439c-8ecc-634955a7a3bc tempest-SnapshotsActionsTest-1847495719 None] Lock "cinder-quobyte-01b7daeb-5dd1-40f5-ba81-36b302279142" released by "delete_volume" :: held 1.563s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:12 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:SELECT=134,cinder:UPDATE=144,cinder:INSERT=46,cinder:DELETE=10 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:10:12 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-ad0520de-c7bc-439c-8ecc-634955a7a3bc tempest-SnapshotsActionsTest-1847495719 None] Created reservations ['85786776-9b16-4b77-9c08-44dcb489a539', '626b9bbd-d6c2-4d17-8007-4ea57db03aa8', 'a81dbfb2-4d1c-4297-8c1d-7d5979c36bbb', 'b17f76aa-f08c-44b9-a6ac-ab06a49fe58f'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:10:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ad0520de-c7bc-439c-8ecc-634955a7a3bc tempest-SnapshotsActionsTest-1847495719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ad0520de-c7bc-439c-8ecc-634955a7a3bc tempest-SnapshotsActionsTest-1847495719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:12 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ad0520de-c7bc-439c-8ecc-634955a7a3bc tempest-SnapshotsActionsTest-1847495719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:12 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ad0520de-c7bc-439c-8ecc-634955a7a3bc tempest-SnapshotsActionsTest-1847495719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ad0520de-c7bc-439c-8ecc-634955a7a3bc tempest-SnapshotsActionsTest-1847495719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ad0520de-c7bc-439c-8ecc-634955a7a3bc tempest-SnapshotsActionsTest-1847495719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:12 devstack sudo[86961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:10:12 devstack sudo[86961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:12 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3c1bbf4f-c134-423b-a60e-a561bbb016e7 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "cinder-a067ca48-e6d3-428b-b41a-fa4690bfd970-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:12 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3c1bbf4f-c134-423b-a60e-a561bbb016e7 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-a067ca48-e6d3-428b-b41a-fa4690bfd970-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:12 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3c1bbf4f-c134-423b-a60e-a561bbb016e7 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "cinder-quobyte-a067ca48-e6d3-428b-b41a-fa4690bfd970" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:12 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3c1bbf4f-c134-423b-a60e-a561bbb016e7 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-quobyte-a067ca48-e6d3-428b-b41a-fa4690bfd970" acquired by "delete_volume" :: waited 0.040s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:12 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[564c596c-96d0-4455-abd3-dd4c882314a8]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:10:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3c1bbf4f-c134-423b-a60e-a561bbb016e7 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a067ca48-e6d3-428b-b41a-fa4690bfd970 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:13 devstack sudo[86953]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cf1a70ba-edf5-46d7-8068-b40847277dad tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.874s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:13 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-cf1a70ba-edf5-46d7-8068-b40847277dad tempest-CreateVolumesFromSnapshotTest-2051008310 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:10:13 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-cf1a70ba-edf5-46d7-8068-b40847277dad tempest-CreateVolumesFromSnapshotTest-2051008310 None] Deleted volume successfully. Apr 27 10:10:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-cf1a70ba-edf5-46d7-8068-b40847277dad tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-30c3717c-8341-4ed2-adc8-9d43d73d9f18-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:13 devstack sudo[86971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a067ca48-e6d3-428b-b41a-fa4690bfd970 Apr 27 10:10:13 devstack sudo[86971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:13 devstack sudo[86961]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ad0520de-c7bc-439c-8ecc-634955a7a3bc tempest-SnapshotsActionsTest-1847495719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.938s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:13 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-ad0520de-c7bc-439c-8ecc-634955a7a3bc tempest-SnapshotsActionsTest-1847495719 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:10:13 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-ad0520de-c7bc-439c-8ecc-634955a7a3bc tempest-SnapshotsActionsTest-1847495719 None] Deleted volume successfully. Apr 27 10:10:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ad0520de-c7bc-439c-8ecc-634955a7a3bc tempest-SnapshotsActionsTest-1847495719 None] Lock "cinder-01b7daeb-5dd1-40f5-ba81-36b302279142-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:13 devstack sudo[86971]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3c1bbf4f-c134-423b-a60e-a561bbb016e7 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a067ca48-e6d3-428b-b41a-fa4690bfd970" returned: 0 in 1.039s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3c1bbf4f-c134-423b-a60e-a561bbb016e7 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a067ca48-e6d3-428b-b41a-fa4690bfd970 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:14 devstack sudo[86994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a067ca48-e6d3-428b-b41a-fa4690bfd970 Apr 27 10:10:14 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:14 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3c1bbf4f-c134-423b-a60e-a561bbb016e7 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a067ca48-e6d3-428b-b41a-fa4690bfd970" returned: 0 in 0.858s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:14 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3c1bbf4f-c134-423b-a60e-a561bbb016e7 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-quobyte-a067ca48-e6d3-428b-b41a-fa4690bfd970" released by "delete_volume" :: held 1.987s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:14 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:UPDATE=172,cinder:SELECT=133,cinder:INSERT=40,cinder:DELETE=16 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:10:14 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-3c1bbf4f-c134-423b-a60e-a561bbb016e7 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Created reservations ['56503889-d7fc-4cc1-b54b-a366734333d6', 'a4e74668-89be-490b-9e88-6305590e9007', '5386b4a0-7651-483f-892c-73dfd00b4b69', 'ed3fefdc-7990-4218-be58-2c8da5b639fd'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:10:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3c1bbf4f-c134-423b-a60e-a561bbb016e7 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3c1bbf4f-c134-423b-a60e-a561bbb016e7 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:15 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3c1bbf4f-c134-423b-a60e-a561bbb016e7 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:15 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3c1bbf4f-c134-423b-a60e-a561bbb016e7 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3c1bbf4f-c134-423b-a60e-a561bbb016e7 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3c1bbf4f-c134-423b-a60e-a561bbb016e7 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:15 devstack sudo[87020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:10:15 devstack sudo[87020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:16 devstack sudo[87020]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3c1bbf4f-c134-423b-a60e-a561bbb016e7 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.968s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:16 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-3c1bbf4f-c134-423b-a60e-a561bbb016e7 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:10:16 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-3c1bbf4f-c134-423b-a60e-a561bbb016e7 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Deleted volume successfully. Apr 27 10:10:16 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3c1bbf4f-c134-423b-a60e-a561bbb016e7 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-a067ca48-e6d3-428b-b41a-fa4690bfd970-delete_volume" released by "delete_volume" :: held 3.476s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:16 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-cdf3093e-6b5b-450e-838a-fa5dd10df314 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "cinder-c36567f2-5242-478b-ae7e-03b55ad7f982-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:16 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-cdf3093e-6b5b-450e-838a-fa5dd10df314 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-c36567f2-5242-478b-ae7e-03b55ad7f982-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:16 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-cdf3093e-6b5b-450e-838a-fa5dd10df314 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "cinder-quobyte-c36567f2-5242-478b-ae7e-03b55ad7f982" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:16 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-cdf3093e-6b5b-450e-838a-fa5dd10df314 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-quobyte-c36567f2-5242-478b-ae7e-03b55ad7f982" acquired by "delete_volume" :: waited 0.027s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:16 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[515fb506-43f9-405d-8baa-d3be1c1284b5]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:10:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cdf3093e-6b5b-450e-838a-fa5dd10df314 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c36567f2-5242-478b-ae7e-03b55ad7f982 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:16 devstack cinder-volume[81350]: DEBUG oslo_service.periodic_task [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81350) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 10:10:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:16 devstack sudo[87026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c36567f2-5242-478b-ae7e-03b55ad7f982 Apr 27 10:10:16 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:16 devstack sudo[87027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:10:16 devstack sudo[87027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:17 devstack sudo[87027]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 1.062s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:17 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:10:17 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cdf3093e-6b5b-450e-838a-fa5dd10df314 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c36567f2-5242-478b-ae7e-03b55ad7f982" returned: 0 in 1.262s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cdf3093e-6b5b-450e-838a-fa5dd10df314 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c36567f2-5242-478b-ae7e-03b55ad7f982 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:17 devstack sudo[87041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c36567f2-5242-478b-ae7e-03b55ad7f982 Apr 27 10:10:17 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:18 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cdf3093e-6b5b-450e-838a-fa5dd10df314 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c36567f2-5242-478b-ae7e-03b55ad7f982" returned: 0 in 0.871s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:18 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-cdf3093e-6b5b-450e-838a-fa5dd10df314 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-quobyte-c36567f2-5242-478b-ae7e-03b55ad7f982" released by "delete_volume" :: held 2.203s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:18 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-cdf3093e-6b5b-450e-838a-fa5dd10df314 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Created reservations ['30ab5b78-ce61-4dc9-9262-4442c0284f0a', '4feff37c-a9f7-4e84-86df-ed73bd3e4d3e', '899772e3-a5a7-48f9-86cf-f99d4fb3694c', '1c60d98a-ad18-40a2-bcf3-ac35c17e59fe'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:10:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-cdf3093e-6b5b-450e-838a-fa5dd10df314 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-cdf3093e-6b5b-450e-838a-fa5dd10df314 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:18 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-cdf3093e-6b5b-450e-838a-fa5dd10df314 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:18 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-cdf3093e-6b5b-450e-838a-fa5dd10df314 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-cdf3093e-6b5b-450e-838a-fa5dd10df314 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cdf3093e-6b5b-450e-838a-fa5dd10df314 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:18 devstack sudo[87062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:10:18 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:19 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cdf3093e-6b5b-450e-838a-fa5dd10df314 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.687s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:19 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-cdf3093e-6b5b-450e-838a-fa5dd10df314 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:10:19 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-cdf3093e-6b5b-450e-838a-fa5dd10df314 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Deleted volume successfully. Apr 27 10:10:19 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-cdf3093e-6b5b-450e-838a-fa5dd10df314 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-c36567f2-5242-478b-ae7e-03b55ad7f982-delete_volume" released by "delete_volume" :: held 3.215s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:19 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9ba42108-d603-4245-8e17-3341f330d7c2 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "cinder-a48ae923-a3ea-429b-8e40-64ab45c8a60d-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:19 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9ba42108-d603-4245-8e17-3341f330d7c2 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-a48ae923-a3ea-429b-8e40-64ab45c8a60d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:19 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9ba42108-d603-4245-8e17-3341f330d7c2 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "cinder-quobyte-a48ae923-a3ea-429b-8e40-64ab45c8a60d" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:19 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9ba42108-d603-4245-8e17-3341f330d7c2 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-quobyte-a48ae923-a3ea-429b-8e40-64ab45c8a60d" acquired by "delete_volume" :: waited 0.021s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:19 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[68700cdb-28fd-42ab-94e1-e1477a910b53]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:10:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9ba42108-d603-4245-8e17-3341f330d7c2 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a48ae923-a3ea-429b-8e40-64ab45c8a60d {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:20 devstack sudo[87083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a48ae923-a3ea-429b-8e40-64ab45c8a60d Apr 27 10:10:20 devstack sudo[87083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:20 devstack sudo[87083]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9ba42108-d603-4245-8e17-3341f330d7c2 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a48ae923-a3ea-429b-8e40-64ab45c8a60d" returned: 0 in 0.691s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9ba42108-d603-4245-8e17-3341f330d7c2 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a48ae923-a3ea-429b-8e40-64ab45c8a60d {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:20 devstack sudo[87089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a48ae923-a3ea-429b-8e40-64ab45c8a60d Apr 27 10:10:20 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:21 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9ba42108-d603-4245-8e17-3341f330d7c2 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a48ae923-a3ea-429b-8e40-64ab45c8a60d" returned: 0 in 0.570s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:21 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9ba42108-d603-4245-8e17-3341f330d7c2 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-quobyte-a48ae923-a3ea-429b-8e40-64ab45c8a60d" released by "delete_volume" :: held 1.322s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:21 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-9ba42108-d603-4245-8e17-3341f330d7c2 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Created reservations ['b15c02b3-7453-4bfb-bd42-c6dacfc394d1', '88e40c39-48c5-48b3-952c-1b7ba60663fc', '30a5774b-0b5f-4791-8dc3-493fdccf0e80', '9ee31d09-ab5d-4cfb-a006-613aca8db35d'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:10:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-9ba42108-d603-4245-8e17-3341f330d7c2 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-9ba42108-d603-4245-8e17-3341f330d7c2 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:21 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-9ba42108-d603-4245-8e17-3341f330d7c2 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:21 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-9ba42108-d603-4245-8e17-3341f330d7c2 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-9ba42108-d603-4245-8e17-3341f330d7c2 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9ba42108-d603-4245-8e17-3341f330d7c2 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:21 devstack sudo[87094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:10:21 devstack sudo[87094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:21 devstack cinder-volume[81350]: INFO cinder.volume.manager [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-773d67e5-8333-43fe-97a8-f634d01ff6d9 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Terminate volume connection completed successfully. Apr 27 10:10:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-773d67e5-8333-43fe-97a8-f634d01ff6d9 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Deleting attachment b047da96-ffa9-4589-bba4-a8fb0a6e7315. {{(pid=81350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 27 10:10:21 devstack sudo[87094]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9ba42108-d603-4245-8e17-3341f330d7c2 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.530s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:21 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-9ba42108-d603-4245-8e17-3341f330d7c2 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:10:21 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-9ba42108-d603-4245-8e17-3341f330d7c2 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Deleted volume successfully. Apr 27 10:10:21 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9ba42108-d603-4245-8e17-3341f330d7c2 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-a48ae923-a3ea-429b-8e40-64ab45c8a60d-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:22 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-1be0a05a-da28-485c-8cbf-c38383112b9f tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Acquiring lock "cinder-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:22 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-1be0a05a-da28-485c-8cbf-c38383112b9f tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Lock "cinder-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:22 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-1be0a05a-da28-485c-8cbf-c38383112b9f tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Acquiring lock "cinder-quobyte-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:22 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-1be0a05a-da28-485c-8cbf-c38383112b9f tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Lock "cinder-quobyte-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2" acquired by "delete_volume" :: waited 0.020s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:22 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e0f5bb67-b8b9-4f6f-b942-6f302f6a8af0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "cinder-7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:22 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e0f5bb67-b8b9-4f6f-b942-6f302f6a8af0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:22 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e0f5bb67-b8b9-4f6f-b942-6f302f6a8af0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "cinder-quobyte-be8a2475-d68d-4d45-b74d-95030da59fd8" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:22 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e0f5bb67-b8b9-4f6f-b942-6f302f6a8af0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-quobyte-be8a2475-d68d-4d45-b74d-95030da59fd8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:22 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e0f5bb67-b8b9-4f6f-b942-6f302f6a8af0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "cinder-quobyte-7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:22 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d860676-2a70-49f3-8548-6928bf392284]: (4, 'raw') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:10:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-1be0a05a-da28-485c-8cbf-c38383112b9f tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:22 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e0f5bb67-b8b9-4f6f-b942-6f302f6a8af0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-quobyte-7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:22 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-e0f5bb67-b8b9-4f6f-b942-6f302f6a8af0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Deleting offline snapshot 7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75 of volume be8a2475-d68d-4d45-b74d-95030da59fd8 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:10:22 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-e0f5bb67-b8b9-4f6f-b942-6f302f6a8af0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] snapshot_file for this snap is: volume-be8a2475-d68d-4d45-b74d-95030da59fd8.7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:10:22 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[122770bc-93e1-423b-aae6-783c93033b6a]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:10:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e0f5bb67-b8b9-4f6f-b942-6f302f6a8af0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:22 devstack sudo[87097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 Apr 27 10:10:22 devstack sudo[87097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:22 devstack sudo[87098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75 Apr 27 10:10:22 devstack sudo[87098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:23 devstack sudo[87098]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e0f5bb67-b8b9-4f6f-b942-6f302f6a8af0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75" returned: 0 in 0.842s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:23 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-e0f5bb67-b8b9-4f6f-b942-6f302f6a8af0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be8a2475-d68d-4d45-b74d-95030da59fd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:10:23 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70663c3-84c8-44a5-943d-b734073f5248]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:10:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e0f5bb67-b8b9-4f6f-b942-6f302f6a8af0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:23 devstack sudo[87097]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-1be0a05a-da28-485c-8cbf-c38383112b9f tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2" returned: 0 in 0.966s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-1be0a05a-da28-485c-8cbf-c38383112b9f tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:23 devstack sudo[87106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8 Apr 27 10:10:23 devstack sudo[87106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:23 devstack sudo[87107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 Apr 27 10:10:23 devstack sudo[87107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:23 devstack sudo[87106]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e0f5bb67-b8b9-4f6f-b942-6f302f6a8af0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8" returned: 0 in 0.663s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e0f5bb67-b8b9-4f6f-b942-6f302f6a8af0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:23 devstack sudo[87116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75 Apr 27 10:10:23 devstack sudo[87116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:23 devstack sudo[87107]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-1be0a05a-da28-485c-8cbf-c38383112b9f tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2" returned: 1 in 0.755s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-1be0a05a-da28-485c-8cbf-c38383112b9f tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2' failed. Not Retrying. {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 10:10:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-1be0a05a-da28-485c-8cbf-c38383112b9f tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:24 devstack sudo[87122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2 Apr 27 10:10:24 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:24 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-1be0a05a-da28-485c-8cbf-c38383112b9f tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2" returned: 0 in 0.678s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:24 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-1be0a05a-da28-485c-8cbf-c38383112b9f tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Lock "cinder-quobyte-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2" released by "delete_volume" :: held 2.525s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:24 devstack sudo[87116]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e0f5bb67-b8b9-4f6f-b942-6f302f6a8af0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75" returned: 0 in 0.861s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e0f5bb67-b8b9-4f6f-b942-6f302f6a8af0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:24 devstack cinder-volume[81350]: DEBUG cinder.quota [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-1be0a05a-da28-485c-8cbf-c38383112b9f tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Created reservations ['fecefa21-4257-4f6c-9ad3-5b4b96ae1ccf', '342407fd-3978-4d18-af64-0e22a0e226aa', 'b3587f3a-47c8-4926-9442-77c6b07ae7d1', '9429fcf7-9137-415d-b72d-19dd6fcd0ce6'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:10:24 devstack sudo[87129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75 Apr 27 10:10:24 devstack sudo[87129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-1be0a05a-da28-485c-8cbf-c38383112b9f tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-1be0a05a-da28-485c-8cbf-c38383112b9f tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:24 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-1be0a05a-da28-485c-8cbf-c38383112b9f tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:24 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-1be0a05a-da28-485c-8cbf-c38383112b9f tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-1be0a05a-da28-485c-8cbf-c38383112b9f tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-1be0a05a-da28-485c-8cbf-c38383112b9f tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:24 devstack sudo[87131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:10:24 devstack sudo[87131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:25 devstack sudo[87129]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e0f5bb67-b8b9-4f6f-b942-6f302f6a8af0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8.7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75" returned: 0 in 0.531s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:25 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e0f5bb67-b8b9-4f6f-b942-6f302f6a8af0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-quobyte-7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75" released by "_delete_snapshot" :: held 3.029s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:25 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e0f5bb67-b8b9-4f6f-b942-6f302f6a8af0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-quobyte-be8a2475-d68d-4d45-b74d-95030da59fd8" released by "delete_snapshot" :: held 3.086s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:25 devstack sudo[87131]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:25 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-e0f5bb67-b8b9-4f6f-b942-6f302f6a8af0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Created reservations ['2b551f9a-11c1-4cf5-a4a3-380586235b0c', '5a38d9b2-34e0-427a-bac8-55657c46f6d9', '7665329e-28f9-48df-9732-86b61e3d86ee', '4160aecc-8b02-449f-9def-66e532e5d139'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:10:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-1be0a05a-da28-485c-8cbf-c38383112b9f tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.568s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:25 devstack cinder-volume[81350]: DEBUG cinder.manager [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-1be0a05a-da28-485c-8cbf-c38383112b9f tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:10:25 devstack cinder-volume[81350]: INFO cinder.volume.manager [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-1be0a05a-da28-485c-8cbf-c38383112b9f tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Deleted volume successfully. Apr 27 10:10:25 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-e0f5bb67-b8b9-4f6f-b942-6f302f6a8af0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Delete snapshot completed successfully. Apr 27 10:10:25 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-855a7ce9-ad60-4905-91d8-14d20fb6bbb1 req-1be0a05a-da28-485c-8cbf-c38383112b9f tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Lock "cinder-b8f3fa20-d2c2-43c5-8fb7-6b72ac45f3e2-delete_volume" released by "delete_volume" :: held 3.401s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:25 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e0f5bb67-b8b9-4f6f-b942-6f302f6a8af0 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-7e0ae5ce-1e49-45bf-95b3-fb8db4f3fb75-delete_snapshot" released by "delete_snapshot" :: held 3.280s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:25 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d3140f80-e15b-409e-94fd-2182aaa5a5a1 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "cinder-be8a2475-d68d-4d45-b74d-95030da59fd8-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:25 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d3140f80-e15b-409e-94fd-2182aaa5a5a1 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-be8a2475-d68d-4d45-b74d-95030da59fd8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:25 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d3140f80-e15b-409e-94fd-2182aaa5a5a1 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "cinder-quobyte-be8a2475-d68d-4d45-b74d-95030da59fd8" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:25 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d3140f80-e15b-409e-94fd-2182aaa5a5a1 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-quobyte-be8a2475-d68d-4d45-b74d-95030da59fd8" acquired by "delete_volume" :: waited 0.020s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:25 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3489fe58-cf53-49ad-8ff6-b479469f2da1]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:10:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d3140f80-e15b-409e-94fd-2182aaa5a5a1 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:26 devstack sudo[87142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8 Apr 27 10:10:26 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:26 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d3140f80-e15b-409e-94fd-2182aaa5a5a1 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8" returned: 0 in 0.650s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d3140f80-e15b-409e-94fd-2182aaa5a5a1 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:26 devstack sudo[87155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8 Apr 27 10:10:26 devstack sudo[87155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:26 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:10:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Flow 'volume_create_manager' (a24ff3dc-e8ec-489f-9aa1-a478459cbac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:10:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19b9654-43eb-420b-8d76-0bc4a2c9ff76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19b9654-43eb-420b-8d76-0bc4a2c9ff76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1483486195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a8658b-6655-4143-b7cb-27258a836f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5c4f222f9274abdb4d0c72e40a6c04d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:10:27Z,use_quota=True,user_id='5e62080715254651aa140775362d375c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38677b81-b6c9-45ce-ada1-f13f9f941bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38677b81-b6c9-45ce-ada1-f13f9f941bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a414d2b0-e27a-46de-b369-0f42f9cffffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a414d2b0-e27a-46de-b369-0f42f9cffffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4a8658b-6655-4143-b7cb-27258a836f91', 'volume_name': 'volume-a4a8658b-6655-4143-b7cb-27258a836f91', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1175ae2b-8a01-4cfb-976b-e99faf522ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1175ae2b-8a01-4cfb-976b-e99faf522ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f91fb9-94f9-4594-9e1a-69358196de23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:27 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Volume a4a8658b-6655-4143-b7cb-27258a836f91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4a8658b-6655-4143-b7cb-27258a836f91', 'volume_size': 1} Apr 27 10:10:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:27 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1483486195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a8658b-6655-4143-b7cb-27258a836f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5c4f222f9274abdb4d0c72e40a6c04d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:10:27Z,use_quota=True,user_id='5e62080715254651aa140775362d375c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:10:27 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Creating volume a4a8658b-6655-4143-b7cb-27258a836f91 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:10:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:27 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:27 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:27 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:10:27 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:10:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a4a8658b-6655-4143-b7cb-27258a836f91 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:27 devstack sudo[87178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a4a8658b-6655-4143-b7cb-27258a836f91 1073741824 Apr 27 10:10:27 devstack sudo[87178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:27 devstack sudo[87155]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d3140f80-e15b-409e-94fd-2182aaa5a5a1 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-be8a2475-d68d-4d45-b74d-95030da59fd8" returned: 0 in 0.750s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:27 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d3140f80-e15b-409e-94fd-2182aaa5a5a1 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-quobyte-be8a2475-d68d-4d45-b74d-95030da59fd8" released by "delete_volume" :: held 1.536s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:27 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-d3140f80-e15b-409e-94fd-2182aaa5a5a1 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Created reservations ['254b830b-06b7-4b4a-b5e3-8908fe9219a5', '2b95ecf9-2d1a-49ef-ba0d-526e97c4788e', '2816a7a6-b9f2-4c44-91bf-83fa11dfca12', '39edc098-1e2d-4eca-bedc-0171aaf1dabd'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:10:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d3140f80-e15b-409e-94fd-2182aaa5a5a1 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d3140f80-e15b-409e-94fd-2182aaa5a5a1 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:27 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d3140f80-e15b-409e-94fd-2182aaa5a5a1 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:27 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d3140f80-e15b-409e-94fd-2182aaa5a5a1 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d3140f80-e15b-409e-94fd-2182aaa5a5a1 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d3140f80-e15b-409e-94fd-2182aaa5a5a1 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:27 devstack sudo[87185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:10:27 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:28 devstack sudo[87178]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a4a8658b-6655-4143-b7cb-27258a836f91 1073741824" returned: 0 in 1.270s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a4a8658b-6655-4143-b7cb-27258a836f91 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:28 devstack sudo[87225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a4a8658b-6655-4143-b7cb-27258a836f91 Apr 27 10:10:28 devstack sudo[87225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:28 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d3140f80-e15b-409e-94fd-2182aaa5a5a1 tempest-CreateVolumesFromSnapshotTest-2051008310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 1.012s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:28 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-d3140f80-e15b-409e-94fd-2182aaa5a5a1 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:10:28 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-d3140f80-e15b-409e-94fd-2182aaa5a5a1 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Deleted volume successfully. Apr 27 10:10:28 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d3140f80-e15b-409e-94fd-2182aaa5a5a1 tempest-CreateVolumesFromSnapshotTest-2051008310 None] Lock "cinder-be8a2475-d68d-4d45-b74d-95030da59fd8-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:29 devstack sudo[87225]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a4a8658b-6655-4143-b7cb-27258a836f91" returned: 0 in 1.003s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:29 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] <== create_volume: return (2356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:10:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.361s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f91fb9-94f9-4594-9e1a-69358196de23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4a8658b-6655-4143-b7cb-27258a836f91', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd06add9-559d-4468-88f8-61a1e2ccc17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:29 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Volume volume-a4a8658b-6655-4143-b7cb-27258a836f91 (a4a8658b-6655-4143-b7cb-27258a836f91): created successfully Apr 27 10:10:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd06add9-559d-4468-88f8-61a1e2ccc17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Flow 'volume_create_manager' (a24ff3dc-e8ec-489f-9aa1-a478459cbac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:10:29 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-d6ec4eb1-5b57-4a1b-999f-9f208d1a7749 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Created volume successfully. Apr 27 10:10:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-63e0867a-23ed-4d5a-b8d2-cbb27ebc1729 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Acquiring lock "cinder-a4a8658b-6655-4143-b7cb-27258a836f91-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-63e0867a-23ed-4d5a-b8d2-cbb27ebc1729 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Lock "cinder-a4a8658b-6655-4143-b7cb-27258a836f91-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-63e0867a-23ed-4d5a-b8d2-cbb27ebc1729 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Acquiring lock "cinder-quobyte-a4a8658b-6655-4143-b7cb-27258a836f91" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-63e0867a-23ed-4d5a-b8d2-cbb27ebc1729 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Lock "cinder-quobyte-a4a8658b-6655-4143-b7cb-27258a836f91" acquired by "delete_volume" :: waited 0.032s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:31 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[da50954e-73fd-41b2-9dd0-92983f870db7]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:10:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-63e0867a-23ed-4d5a-b8d2-cbb27ebc1729 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a4a8658b-6655-4143-b7cb-27258a836f91 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:31 devstack sudo[87236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a4a8658b-6655-4143-b7cb-27258a836f91 Apr 27 10:10:31 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-23bb71a1-b7de-4470-81d1-7f7ec8c2ad57 tempest-VolumesActionsTest-1292551954 None] Acquiring lock "cinder-ad382ce3-d94a-434d-9a6c-13957956a23b" by "attach_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-23bb71a1-b7de-4470-81d1-7f7ec8c2ad57 tempest-VolumesActionsTest-1292551954 None] Lock "cinder-ad382ce3-d94a-434d-9a6c-13957956a23b" acquired by "attach_volume" :: waited 0.021s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:32 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-23bb71a1-b7de-4470-81d1-7f7ec8c2ad57 tempest-VolumesActionsTest-1292551954 None] Attaching volume ad382ce3-d94a-434d-9a6c-13957956a23b to instance 47ee81bb-156c-4034-bd0c-5451a38eaa62 at mountpoint /dev/vdb on host None. Apr 27 10:10:32 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-23bb71a1-b7de-4470-81d1-7f7ec8c2ad57 tempest-VolumesActionsTest-1292551954 None] Attach volume completed successfully. Apr 27 10:10:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-23bb71a1-b7de-4470-81d1-7f7ec8c2ad57 tempest-VolumesActionsTest-1292551954 None] Lock "cinder-ad382ce3-d94a-434d-9a6c-13957956a23b" released by "attach_volume" :: held 0.105s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:32 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-63e0867a-23ed-4d5a-b8d2-cbb27ebc1729 tempest-VolumeQuotasNegativeTestJSON-337261221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a4a8658b-6655-4143-b7cb-27258a836f91" returned: 0 in 0.876s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-63e0867a-23ed-4d5a-b8d2-cbb27ebc1729 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a4a8658b-6655-4143-b7cb-27258a836f91 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:32 devstack sudo[87241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a4a8658b-6655-4143-b7cb-27258a836f91 Apr 27 10:10:32 devstack sudo[87241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9d3cde8a-3d25-436f-b09c-de6e63f5901f tempest-VolumesActionsTest-1292551954 None] Acquiring lock "cinder-ad382ce3-d94a-434d-9a6c-13957956a23b-detach_volume" by "detach_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9d3cde8a-3d25-436f-b09c-de6e63f5901f tempest-VolumesActionsTest-1292551954 None] Lock "cinder-ad382ce3-d94a-434d-9a6c-13957956a23b-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:32 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-9d3cde8a-3d25-436f-b09c-de6e63f5901f tempest-VolumesActionsTest-1292551954 None] Detaching volume ad382ce3-d94a-434d-9a6c-13957956a23b from instance 47ee81bb-156c-4034-bd0c-5451a38eaa62. Apr 27 10:10:32 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-9d3cde8a-3d25-436f-b09c-de6e63f5901f tempest-VolumesActionsTest-1292551954 None] Detach volume completed successfully. Apr 27 10:10:32 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:10:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Flow 'volume_create_manager' (c32f7128-147d-4b31-8a43-e5a463ec4f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:10:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cd58658-a166-4fd1-9858-dde1479170de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9d3cde8a-3d25-436f-b09c-de6e63f5901f tempest-VolumesActionsTest-1292551954 None] Lock "cinder-ad382ce3-d94a-434d-9a6c-13957956a23b-detach_volume" released by "detach_volume" :: held 0.217s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cd58658-a166-4fd1-9858-dde1479170de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1860675940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a51140180643f6a201c5b3ff3863d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:10:33Z,use_quota=True,user_id='f9e7d0a415e84556a3865eed3ffc16ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa633b1-be77-4ee3-b496-effa349f98f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa633b1-be77-4ee3-b496-effa349f98f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f79afc-ba63-46f3-b275-8e4528bbf038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f79afc-ba63-46f3-b275-8e4528bbf038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86', 'volume_name': 'volume-9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3421ad1-b7db-431b-bace-846347691778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3421ad1-b7db-431b-bace-846347691778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f2ee9de-bb64-481e-92ec-15ec9d5dcbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:33 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Volume 9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86', 'volume_size': 1} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1860675940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a51140180643f6a201c5b3ff3863d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:10:33Z,use_quota=True,user_id='f9e7d0a415e84556a3865eed3ffc16ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Creating volume 9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:10:33 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:33 devstack sudo[87243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86 1073741824 Apr 27 10:10:33 devstack sudo[87243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:33 devstack sudo[87241]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-63e0867a-23ed-4d5a-b8d2-cbb27ebc1729 tempest-VolumeQuotasNegativeTestJSON-337261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a4a8658b-6655-4143-b7cb-27258a836f91" returned: 0 in 0.727s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-63e0867a-23ed-4d5a-b8d2-cbb27ebc1729 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Lock "cinder-quobyte-a4a8658b-6655-4143-b7cb-27258a836f91" released by "delete_volume" :: held 1.669s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-63e0867a-23ed-4d5a-b8d2-cbb27ebc1729 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Created reservations ['db05db8b-e7aa-4060-a8db-5aa2308b1528', '7769abe2-3d45-46c8-a111-f20a3afb206e', 'c58c9a75-5cf2-4135-8546-2a90a522b491', '92f2c15c-f1d0-422d-bed1-411d606d95d9'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-63e0867a-23ed-4d5a-b8d2-cbb27ebc1729 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-63e0867a-23ed-4d5a-b8d2-cbb27ebc1729 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-63e0867a-23ed-4d5a-b8d2-cbb27ebc1729 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-63e0867a-23ed-4d5a-b8d2-cbb27ebc1729 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-63e0867a-23ed-4d5a-b8d2-cbb27ebc1729 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-63e0867a-23ed-4d5a-b8d2-cbb27ebc1729 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:33 devstack sudo[87246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:10:33 devstack sudo[87246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:34 devstack sudo[87243]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86 1073741824" returned: 0 in 1.085s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:34 devstack sudo[87252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86 Apr 27 10:10:34 devstack sudo[87252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:34 devstack sudo[87246]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-63e0867a-23ed-4d5a-b8d2-cbb27ebc1729 tempest-VolumeQuotasNegativeTestJSON-337261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 1.081s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:34 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-63e0867a-23ed-4d5a-b8d2-cbb27ebc1729 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:10:34 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-63e0867a-23ed-4d5a-b8d2-cbb27ebc1729 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Deleted volume successfully. Apr 27 10:10:34 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-63e0867a-23ed-4d5a-b8d2-cbb27ebc1729 tempest-VolumeQuotasNegativeTestJSON-337261221 None] Lock "cinder-a4a8658b-6655-4143-b7cb-27258a836f91-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:34 devstack sudo[87252]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86" returned: 0 in 0.745s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:10:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f2ee9de-bb64-481e-92ec-15ec9d5dcbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7462dd95-10e9-41c5-a3b4-2fe38a602511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:35 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Volume volume-9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86 (9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86): created successfully Apr 27 10:10:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7462dd95-10e9-41c5-a3b4-2fe38a602511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Flow 'volume_create_manager' (c32f7128-147d-4b31-8a43-e5a463ec4f55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:10:35 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-0a1495a5-1e88-4aa1-851a-eafcfdc123a7 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Created volume successfully. Apr 27 10:10:35 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:10:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Flow 'volume_create_manager' (f1537516-a35c-4b48-b09f-932ba1607be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:10:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f232e85-9a65-4f29-8bea-b6c8527b9239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f232e85-9a65-4f29-8bea-b6c8527b9239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1762967208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02fb333-02b2-48ae-8993-05572fc5ba60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a51140180643f6a201c5b3ff3863d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:10:36Z,use_quota=True,user_id='f9e7d0a415e84556a3865eed3ffc16ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42cab206-b88d-4a44-ae65-ced6781d58fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42cab206-b88d-4a44-ae65-ced6781d58fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024f6f65-ddec-461e-8242-e52f9efcb70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024f6f65-ddec-461e-8242-e52f9efcb70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f02fb333-02b2-48ae-8993-05572fc5ba60', 'volume_name': 'volume-f02fb333-02b2-48ae-8993-05572fc5ba60', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59374f7b-429f-4e3d-94a4-a1bca489dfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59374f7b-429f-4e3d-94a4-a1bca489dfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34433bde-efda-42bd-9988-d01deffb85ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:35 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Volume f02fb333-02b2-48ae-8993-05572fc5ba60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f02fb333-02b2-48ae-8993-05572fc5ba60', 'volume_size': 1} Apr 27 10:10:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1762967208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02fb333-02b2-48ae-8993-05572fc5ba60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a51140180643f6a201c5b3ff3863d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:10:36Z,use_quota=True,user_id='f9e7d0a415e84556a3865eed3ffc16ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:10:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Creating volume f02fb333-02b2-48ae-8993-05572fc5ba60 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:10:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:10:36 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:10:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f02fb333-02b2-48ae-8993-05572fc5ba60 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:36 devstack sudo[87297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f02fb333-02b2-48ae-8993-05572fc5ba60 1073741824 Apr 27 10:10:36 devstack sudo[87297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:36 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:10:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Flow 'volume_create_manager' (07965462-fe66-452a-96cc-671819e0540e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:10:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f73743-94bc-4f28-9a68-dd47276d7b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f73743-94bc-4f28-9a68-dd47276d7b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-640786934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a23cf7-0b88-4040-94a7-0ab548e2832d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a51140180643f6a201c5b3ff3863d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:10:36Z,use_quota=True,user_id='f9e7d0a415e84556a3865eed3ffc16ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c881a5-61c4-47e9-bd5b-83b9dc0edd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c881a5-61c4-47e9-bd5b-83b9dc0edd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34942d48-61ed-4638-a6b3-ab57b26b30df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34942d48-61ed-4638-a6b3-ab57b26b30df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2a23cf7-0b88-4040-94a7-0ab548e2832d', 'volume_name': 'volume-c2a23cf7-0b88-4040-94a7-0ab548e2832d', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29521bb4-5a8e-4efe-a7b7-9ab71e4e539c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29521bb4-5a8e-4efe-a7b7-9ab71e4e539c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26eb447a-f54a-4a06-8d3a-c227d271fa80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:36 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Volume c2a23cf7-0b88-4040-94a7-0ab548e2832d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2a23cf7-0b88-4040-94a7-0ab548e2832d', 'volume_size': 1} Apr 27 10:10:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:36 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:10:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Flow 'volume_create_manager' (5eea6f32-6293-4dd1-a71b-46c8d1854df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:10:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0fdb347-7580-4ae9-9695-34ebf04bb003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0fdb347-7580-4ae9-9695-34ebf04bb003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2071920552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36b16d3-cf20-4130-856b-db20bdbe76b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a51140180643f6a201c5b3ff3863d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:10:37Z,use_quota=True,user_id='f9e7d0a415e84556a3865eed3ffc16ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4748aee4-b0f0-4261-9957-e211e542a5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:37 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4748aee4-b0f0-4261-9957-e211e542a5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:37 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20adc128-2df2-4e98-b5b7-94933d751104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:37 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20adc128-2df2-4e98-b5b7-94933d751104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd36b16d3-cf20-4130-856b-db20bdbe76b7', 'volume_name': 'volume-d36b16d3-cf20-4130-856b-db20bdbe76b7', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:37 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f13d4b-cfbd-4c55-a6ac-d904225ec1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:37 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f13d4b-cfbd-4c55-a6ac-d904225ec1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:37 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce165a8-dc9c-4439-b3e3-ba59f48f9eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:37 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Volume d36b16d3-cf20-4130-856b-db20bdbe76b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d36b16d3-cf20-4130-856b-db20bdbe76b7', 'volume_size': 1} Apr 27 10:10:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:37 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:10:37 devstack sudo[87297]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:37 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Flow 'volume_create_manager' (2e880b42-6848-4676-80f2-d539dab8fa5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:10:37 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f35f62e-9927-4fae-930c-bd35a16f98ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f02fb333-02b2-48ae-8993-05572fc5ba60 1073741824" returned: 0 in 1.528s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:37 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f35f62e-9927-4fae-930c-bd35a16f98ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1832143757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3eb020b-0171-495d-aed2-d1236750443e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a51140180643f6a201c5b3ff3863d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:10:37Z,use_quota=True,user_id='f9e7d0a415e84556a3865eed3ffc16ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:37 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (617ca306-6ab8-4330-8ac7-e50e729ca1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:37 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (617ca306-6ab8-4330-8ac7-e50e729ca1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:37 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38a4427-1c94-4539-bb5c-2dd0c147437b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:37 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38a4427-1c94-4539-bb5c-2dd0c147437b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3eb020b-0171-495d-aed2-d1236750443e', 'volume_name': 'volume-e3eb020b-0171-495d-aed2-d1236750443e', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:37 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b6ded7b-d56c-4015-9dd6-661a30c87b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:37 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b6ded7b-d56c-4015-9dd6-661a30c87b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:37 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f5aab8-420a-43fa-aeb0-3968fc20da14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:37 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Volume e3eb020b-0171-495d-aed2-d1236750443e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3eb020b-0171-495d-aed2-d1236750443e', 'volume_size': 1} Apr 27 10:10:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f02fb333-02b2-48ae-8993-05572fc5ba60 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:37 devstack sudo[87324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f02fb333-02b2-48ae-8993-05572fc5ba60 Apr 27 10:10:37 devstack sudo[87324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Flow 'volume_create_manager' (cafdf7f8-4a72-42bb-8e2d-e29def2162a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11d49fc-a774-4d62-a6b2-bcee1e8d1a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11d49fc-a774-4d62-a6b2-bcee1e8d1a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-77135809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a86997d-09ae-472a-8e39-d1512432c2cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a51140180643f6a201c5b3ff3863d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:10:38Z,use_quota=True,user_id='f9e7d0a415e84556a3865eed3ffc16ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4855b3c0-59c2-4527-ad25-ead6a8a59346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4855b3c0-59c2-4527-ad25-ead6a8a59346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d708059-e86d-4ce1-a1d7-8200e508eb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d708059-e86d-4ce1-a1d7-8200e508eb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a86997d-09ae-472a-8e39-d1512432c2cc', 'volume_name': 'volume-4a86997d-09ae-472a-8e39-d1512432c2cc', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012e6d0d-b546-488c-a126-14db9da4c512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012e6d0d-b546-488c-a126-14db9da4c512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4934cb5-f100-47d5-a302-0022b3a02b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:38 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Volume 4a86997d-09ae-472a-8e39-d1512432c2cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a86997d-09ae-472a-8e39-d1512432c2cc', 'volume_size': 1} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:38 devstack sudo[87324]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f02fb333-02b2-48ae-8993-05572fc5ba60" returned: 0 in 0.830s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] <== create_volume: return (2471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.474s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.890s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-640786934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a23cf7-0b88-4040-94a7-0ab548e2832d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a51140180643f6a201c5b3ff3863d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:10:36Z,use_quota=True,user_id='f9e7d0a415e84556a3865eed3ffc16ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Creating volume c2a23cf7-0b88-4040-94a7-0ab548e2832d {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:10:38 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c2a23cf7-0b88-4040-94a7-0ab548e2832d 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34433bde-efda-42bd-9988-d01deffb85ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f02fb333-02b2-48ae-8993-05572fc5ba60', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d8fceec-9afd-469a-8c6a-aefbd44a5eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:38 devstack sudo[87330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c2a23cf7-0b88-4040-94a7-0ab548e2832d 1073741824 Apr 27 10:10:38 devstack sudo[87330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:38 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Volume volume-f02fb333-02b2-48ae-8993-05572fc5ba60 (f02fb333-02b2-48ae-8993-05572fc5ba60): created successfully Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d8fceec-9afd-469a-8c6a-aefbd44a5eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Flow 'volume_create_manager' (f1537516-a35c-4b48-b09f-932ba1607be7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:10:38 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-f29216ef-9aec-408c-b3af-5815d7b1a334 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Created volume successfully. Apr 27 10:10:39 devstack sudo[87330]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c2a23cf7-0b88-4040-94a7-0ab548e2832d 1073741824" returned: 0 in 0.800s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:39 devstack cinder-volume[81350]: INFO cinder.volume.manager [req-75d45b74-62ab-40a3-988b-64eea4812f90 req-fe6b5cbe-56b2-4a02-bedf-f5ad5636d61e tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Terminate volume connection completed successfully. Apr 27 10:10:39 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [req-75d45b74-62ab-40a3-988b-64eea4812f90 req-fe6b5cbe-56b2-4a02-bedf-f5ad5636d61e tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Deleting attachment 0271d22c-f403-4676-baa7-89f17e38a852. {{(pid=81350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 27 10:10:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c2a23cf7-0b88-4040-94a7-0ab548e2832d {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:39 devstack sudo[87335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c2a23cf7-0b88-4040-94a7-0ab548e2832d Apr 27 10:10:39 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:39 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c2a23cf7-0b88-4040-94a7-0ab548e2832d" returned: 0 in 0.534s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:39 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:10:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.824s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:39 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2071920552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36b16d3-cf20-4130-856b-db20bdbe76b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a51140180643f6a201c5b3ff3863d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:10:37Z,use_quota=True,user_id='f9e7d0a415e84556a3865eed3ffc16ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:10:39 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Creating volume d36b16d3-cf20-4130-856b-db20bdbe76b7 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:10:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:39 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:39 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:39 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:10:39 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:10:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d36b16d3-cf20-4130-856b-db20bdbe76b7 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:39 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26eb447a-f54a-4a06-8d3a-c227d271fa80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2a23cf7-0b88-4040-94a7-0ab548e2832d', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:39 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01aff4f7-6837-44b5-a395-d20624967eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:39 devstack sudo[87338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d36b16d3-cf20-4130-856b-db20bdbe76b7 1073741824 Apr 27 10:10:39 devstack sudo[87338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:39 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Volume volume-c2a23cf7-0b88-4040-94a7-0ab548e2832d (c2a23cf7-0b88-4040-94a7-0ab548e2832d): created successfully Apr 27 10:10:39 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01aff4f7-6837-44b5-a395-d20624967eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:39 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Flow 'volume_create_manager' (07965462-fe66-452a-96cc-671819e0540e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:10:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-75d45b74-62ab-40a3-988b-64eea4812f90 req-2703a1b2-8c9e-476d-9fc6-180abe76e066 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Acquiring lock "cinder-dfa06ea4-c4ee-426d-8bcf-1be897461a05-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:39 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-590a615d-490d-4332-b9ac-03ec393681fe tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Created volume successfully. Apr 27 10:10:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-75d45b74-62ab-40a3-988b-64eea4812f90 req-2703a1b2-8c9e-476d-9fc6-180abe76e066 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Lock "cinder-dfa06ea4-c4ee-426d-8bcf-1be897461a05-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-75d45b74-62ab-40a3-988b-64eea4812f90 req-2703a1b2-8c9e-476d-9fc6-180abe76e066 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Acquiring lock "cinder-quobyte-dfa06ea4-c4ee-426d-8bcf-1be897461a05" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:40 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-75d45b74-62ab-40a3-988b-64eea4812f90 req-2703a1b2-8c9e-476d-9fc6-180abe76e066 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Lock "cinder-quobyte-dfa06ea4-c4ee-426d-8bcf-1be897461a05" acquired by "delete_volume" :: waited 0.020s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:40 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4f231d-b0a4-46e3-8cd0-95c90aeb9a27]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:10:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-75d45b74-62ab-40a3-988b-64eea4812f90 req-2703a1b2-8c9e-476d-9fc6-180abe76e066 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfa06ea4-c4ee-426d-8bcf-1be897461a05 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:40 devstack sudo[87340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfa06ea4-c4ee-426d-8bcf-1be897461a05 Apr 27 10:10:40 devstack sudo[87340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:40 devstack sudo[87340]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-75d45b74-62ab-40a3-988b-64eea4812f90 req-2703a1b2-8c9e-476d-9fc6-180abe76e066 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfa06ea4-c4ee-426d-8bcf-1be897461a05" returned: 0 in 0.693s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-75d45b74-62ab-40a3-988b-64eea4812f90 req-2703a1b2-8c9e-476d-9fc6-180abe76e066 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfa06ea4-c4ee-426d-8bcf-1be897461a05 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:40 devstack sudo[87338]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d36b16d3-cf20-4130-856b-db20bdbe76b7 1073741824" returned: 0 in 0.923s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:40 devstack sudo[87348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfa06ea4-c4ee-426d-8bcf-1be897461a05 Apr 27 10:10:40 devstack sudo[87348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d36b16d3-cf20-4130-856b-db20bdbe76b7 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:40 devstack sudo[87350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d36b16d3-cf20-4130-856b-db20bdbe76b7 Apr 27 10:10:40 devstack sudo[87350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:41 devstack sudo[87350]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d36b16d3-cf20-4130-856b-db20bdbe76b7" returned: 0 in 0.540s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.780s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1832143757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3eb020b-0171-495d-aed2-d1236750443e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a51140180643f6a201c5b3ff3863d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:10:37Z,use_quota=True,user_id='f9e7d0a415e84556a3865eed3ffc16ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Creating volume e3eb020b-0171-495d-aed2-d1236750443e {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:41 devstack sudo[87348]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:10:41 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e3eb020b-0171-495d-aed2-d1236750443e 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-75d45b74-62ab-40a3-988b-64eea4812f90 req-2703a1b2-8c9e-476d-9fc6-180abe76e066 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dfa06ea4-c4ee-426d-8bcf-1be897461a05" returned: 0 in 0.668s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:41 devstack sudo[87354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e3eb020b-0171-495d-aed2-d1236750443e 1073741824 Apr 27 10:10:41 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce165a8-dc9c-4439-b3e3-ba59f48f9eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d36b16d3-cf20-4130-856b-db20bdbe76b7', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f659571f-a73e-453c-b797-e739fc986658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-75d45b74-62ab-40a3-988b-64eea4812f90 req-2703a1b2-8c9e-476d-9fc6-180abe76e066 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Lock "cinder-quobyte-dfa06ea4-c4ee-426d-8bcf-1be897461a05" released by "delete_volume" :: held 1.456s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:41 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Volume volume-d36b16d3-cf20-4130-856b-db20bdbe76b7 (d36b16d3-cf20-4130-856b-db20bdbe76b7): created successfully Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f659571f-a73e-453c-b797-e739fc986658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Flow 'volume_create_manager' (5eea6f32-6293-4dd1-a71b-46c8d1854df6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:10:41 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-12b731e1-cfa8-4d40-972f-850ee2b10fff tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Created volume successfully. Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.quota [req-75d45b74-62ab-40a3-988b-64eea4812f90 req-2703a1b2-8c9e-476d-9fc6-180abe76e066 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Created reservations ['0876e789-45bf-4156-a8cc-a9f2756c2c72', '6ffd3525-3b28-4040-a335-2583240d75da', '57918fd1-2f8b-4489-bada-9accdb345df9', 'd5216c34-3ccd-47da-84f7-1222f9f3d8be'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-75d45b74-62ab-40a3-988b-64eea4812f90 req-2703a1b2-8c9e-476d-9fc6-180abe76e066 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-75d45b74-62ab-40a3-988b-64eea4812f90 req-2703a1b2-8c9e-476d-9fc6-180abe76e066 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-75d45b74-62ab-40a3-988b-64eea4812f90 req-2703a1b2-8c9e-476d-9fc6-180abe76e066 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [req-75d45b74-62ab-40a3-988b-64eea4812f90 req-2703a1b2-8c9e-476d-9fc6-180abe76e066 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [req-75d45b74-62ab-40a3-988b-64eea4812f90 req-2703a1b2-8c9e-476d-9fc6-180abe76e066 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-75d45b74-62ab-40a3-988b-64eea4812f90 req-2703a1b2-8c9e-476d-9fc6-180abe76e066 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:41 devstack sudo[87356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:10:41 devstack sudo[87356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Flow 'volume_create_manager' (0365fd65-1c7a-4abc-92d3-7b21479ab09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f900435-21c7-49ce-b220-a27f4b58c090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f900435-21c7-49ce-b220-a27f4b58c090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1106998565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53bcb47b5c9c4f3f9a4b0d95d4dfa3cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:10:42Z,use_quota=True,user_id='095827e3ef484ea28e8b9f5f1bcfc128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f0fec63-8b9d-4d2d-883e-38c8948b2c58),volume_type_id=5f0fec63-8b9d-4d2d-883e-38c8948b2c58)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ffdc25-a8c8-47aa-b4a0-b26633687c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ffdc25-a8c8-47aa-b4a0-b26633687c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93fea0de-b8a2-4880-9b55-5fcd5def36ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93fea0de-b8a2-4880-9b55-5fcd5def36ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48', 'volume_name': 'volume-f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd495db-ca66-44e4-856a-606febdc291a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd495db-ca66-44e4-856a-606febdc291a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd3ceb25-088d-41b3-acd6-04f34101a4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:41 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Volume f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48', 'volume_size': 1} Apr 27 10:10:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:42 devstack sudo[87356]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [req-75d45b74-62ab-40a3-988b-64eea4812f90 req-2703a1b2-8c9e-476d-9fc6-180abe76e066 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.644s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:42 devstack cinder-volume[81350]: DEBUG cinder.manager [req-75d45b74-62ab-40a3-988b-64eea4812f90 req-2703a1b2-8c9e-476d-9fc6-180abe76e066 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:10:42 devstack cinder-volume[81350]: INFO cinder.volume.manager [req-75d45b74-62ab-40a3-988b-64eea4812f90 req-2703a1b2-8c9e-476d-9fc6-180abe76e066 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Deleted volume successfully. Apr 27 10:10:42 devstack cinder-volume[81350]: DEBUG cinder.coordination [req-75d45b74-62ab-40a3-988b-64eea4812f90 req-2703a1b2-8c9e-476d-9fc6-180abe76e066 tempest-ServerBootFromVolumeStableRescueTest-1812682998 None] Lock "cinder-dfa06ea4-c4ee-426d-8bcf-1be897461a05-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:42 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e3eb020b-0171-495d-aed2-d1236750443e 1073741824" returned: 0 in 0.981s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e3eb020b-0171-495d-aed2-d1236750443e {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:42 devstack sudo[87365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e3eb020b-0171-495d-aed2-d1236750443e Apr 27 10:10:42 devstack sudo[87365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:42 devstack sudo[87365]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e3eb020b-0171-495d-aed2-d1236750443e" returned: 0 in 0.492s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:42 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:10:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.795s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:42 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-77135809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a86997d-09ae-472a-8e39-d1512432c2cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a51140180643f6a201c5b3ff3863d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:10:38Z,use_quota=True,user_id='f9e7d0a415e84556a3865eed3ffc16ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:10:42 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Creating volume 4a86997d-09ae-472a-8e39-d1512432c2cc {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:10:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:42 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:42 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:42 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:10:42 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:10:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4a86997d-09ae-472a-8e39-d1512432c2cc 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:42 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f5aab8-420a-43fa-aeb0-3968fc20da14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3eb020b-0171-495d-aed2-d1236750443e', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:42 devstack sudo[87369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4a86997d-09ae-472a-8e39-d1512432c2cc 1073741824 Apr 27 10:10:42 devstack sudo[87369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:42 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be35e323-5557-4947-89be-da99760014c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:42 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Volume volume-e3eb020b-0171-495d-aed2-d1236750443e (e3eb020b-0171-495d-aed2-d1236750443e): created successfully Apr 27 10:10:42 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be35e323-5557-4947-89be-da99760014c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:42 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Flow 'volume_create_manager' (2e880b42-6848-4676-80f2-d539dab8fa5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:10:43 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-defdbbc5-60ab-4f3d-820f-c66c5a69881e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Created volume successfully. Apr 27 10:10:43 devstack sudo[87369]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4a86997d-09ae-472a-8e39-d1512432c2cc 1073741824" returned: 0 in 0.743s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4a86997d-09ae-472a-8e39-d1512432c2cc {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:43 devstack sudo[87376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4a86997d-09ae-472a-8e39-d1512432c2cc Apr 27 10:10:43 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:44 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4a86997d-09ae-472a-8e39-d1512432c2cc" returned: 0 in 0.476s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:44 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:10:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.269s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:44 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1106998565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53bcb47b5c9c4f3f9a4b0d95d4dfa3cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:10:42Z,use_quota=True,user_id='095827e3ef484ea28e8b9f5f1bcfc128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f0fec63-8b9d-4d2d-883e-38c8948b2c58),volume_type_id=5f0fec63-8b9d-4d2d-883e-38c8948b2c58)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:10:44 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Creating volume f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:10:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:44 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:44 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:44 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:10:44 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:10:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4934cb5-f100-47d5-a302-0022b3a02b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a86997d-09ae-472a-8e39-d1512432c2cc', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5999c85b-8070-4d14-990a-45b1137905ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:44 devstack sudo[87379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48 1073741824 Apr 27 10:10:44 devstack sudo[87379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:44 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Volume volume-4a86997d-09ae-472a-8e39-d1512432c2cc (4a86997d-09ae-472a-8e39-d1512432c2cc): created successfully Apr 27 10:10:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5999c85b-8070-4d14-990a-45b1137905ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Flow 'volume_create_manager' (cafdf7f8-4a72-42bb-8e2d-e29def2162a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:10:44 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-2c2bc86e-d432-49a1-9b00-3e9bd11a43dc tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Created volume successfully. Apr 27 10:10:44 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ae96577f-a60d-40bf-8ff9-dd74bb367627 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "cinder-4a86997d-09ae-472a-8e39-d1512432c2cc-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:44 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ae96577f-a60d-40bf-8ff9-dd74bb367627 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "cinder-4a86997d-09ae-472a-8e39-d1512432c2cc-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:44 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ae96577f-a60d-40bf-8ff9-dd74bb367627 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "cinder-quobyte-4a86997d-09ae-472a-8e39-d1512432c2cc" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:44 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ae96577f-a60d-40bf-8ff9-dd74bb367627 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "cinder-quobyte-4a86997d-09ae-472a-8e39-d1512432c2cc" acquired by "delete_volume" :: waited 0.044s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:44 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e6e6ac-ecef-49f0-a013-9a76eae92f58]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:10:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ae96577f-a60d-40bf-8ff9-dd74bb367627 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4a86997d-09ae-472a-8e39-d1512432c2cc {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:45 devstack sudo[87398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4a86997d-09ae-472a-8e39-d1512432c2cc Apr 27 10:10:45 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:45 devstack sudo[87379]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48 1073741824" returned: 0 in 1.089s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:45 devstack sudo[87418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48 Apr 27 10:10:45 devstack sudo[87418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:45 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ae96577f-a60d-40bf-8ff9-dd74bb367627 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4a86997d-09ae-472a-8e39-d1512432c2cc" returned: 0 in 0.690s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ae96577f-a60d-40bf-8ff9-dd74bb367627 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4a86997d-09ae-472a-8e39-d1512432c2cc {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:45 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4a86997d-09ae-472a-8e39-d1512432c2cc Apr 27 10:10:45 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:45 devstack sudo[87418]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48" returned: 0 in 0.483s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:45 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:10:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:45 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd3ceb25-088d-41b3-acd6-04f34101a4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:45 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a30da9f-9745-4f78-8171-d3525c2248b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:45 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Volume volume-f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48 (f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48): created successfully Apr 27 10:10:45 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a30da9f-9745-4f78-8171-d3525c2248b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:45 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Flow 'volume_create_manager' (0365fd65-1c7a-4abc-92d3-7b21479ab09e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:10:45 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-c164ec82-f8f7-4019-a9c3-f426e880731c tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Created volume successfully. Apr 27 10:10:46 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ae96577f-a60d-40bf-8ff9-dd74bb367627 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4a86997d-09ae-472a-8e39-d1512432c2cc" returned: 0 in 0.499s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:46 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ae96577f-a60d-40bf-8ff9-dd74bb367627 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "cinder-quobyte-4a86997d-09ae-472a-8e39-d1512432c2cc" released by "delete_volume" :: held 1.241s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:46 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-ae96577f-a60d-40bf-8ff9-dd74bb367627 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Created reservations ['bf7afacb-cee3-4270-ac11-bdc38d2a7032', '0728c08c-1a6c-4ecb-b885-177b0ff636af', 'd3fb2c71-5dee-42f8-9649-436c42bed303', '4c41036e-4df9-4a23-bdbb-b0c1264799a2'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:10:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ae96577f-a60d-40bf-8ff9-dd74bb367627 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ae96577f-a60d-40bf-8ff9-dd74bb367627 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:46 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ae96577f-a60d-40bf-8ff9-dd74bb367627 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:46 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ae96577f-a60d-40bf-8ff9-dd74bb367627 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ae96577f-a60d-40bf-8ff9-dd74bb367627 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ae96577f-a60d-40bf-8ff9-dd74bb367627 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:46 devstack sudo[87428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:10:46 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-46f96419-bedf-40b5-b602-befafa2d89dd tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-46f96419-bedf-40b5-b602-befafa2d89dd tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:46 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-46f96419-bedf-40b5-b602-befafa2d89dd tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:46 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-46f96419-bedf-40b5-b602-befafa2d89dd tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-46f96419-bedf-40b5-b602-befafa2d89dd tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-46f96419-bedf-40b5-b602-befafa2d89dd tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:46 devstack sudo[87430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:10:46 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:47 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ae96577f-a60d-40bf-8ff9-dd74bb367627 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.732s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:47 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-ae96577f-a60d-40bf-8ff9-dd74bb367627 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:10:47 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-ae96577f-a60d-40bf-8ff9-dd74bb367627 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Deleted volume successfully. Apr 27 10:10:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ae96577f-a60d-40bf-8ff9-dd74bb367627 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "cinder-4a86997d-09ae-472a-8e39-d1512432c2cc-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-aecebcf8-eddf-474b-a20e-48df131a928f tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "cinder-e3eb020b-0171-495d-aed2-d1236750443e-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-aecebcf8-eddf-474b-a20e-48df131a928f tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "cinder-e3eb020b-0171-495d-aed2-d1236750443e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:47 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-46f96419-bedf-40b5-b602-befafa2d89dd tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.625s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:47 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-46f96419-bedf-40b5-b602-befafa2d89dd tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:10:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-aecebcf8-eddf-474b-a20e-48df131a928f tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "cinder-quobyte-e3eb020b-0171-495d-aed2-d1236750443e" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:47 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-46f96419-bedf-40b5-b602-befafa2d89dd tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Retype volume completed successfully. Apr 27 10:10:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-aecebcf8-eddf-474b-a20e-48df131a928f tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "cinder-quobyte-e3eb020b-0171-495d-aed2-d1236750443e" acquired by "delete_volume" :: waited 0.037s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:47 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0f8166-8af0-4004-8fcf-6b8f36eb054c]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:10:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-aecebcf8-eddf-474b-a20e-48df131a928f tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e3eb020b-0171-495d-aed2-d1236750443e {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:47 devstack sudo[87435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e3eb020b-0171-495d-aed2-d1236750443e Apr 27 10:10:47 devstack sudo[87435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fe156909-90a7-4434-9799-f06f81bbc7bb tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Acquiring lock "cinder-f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fe156909-90a7-4434-9799-f06f81bbc7bb tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Lock "cinder-f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fe156909-90a7-4434-9799-f06f81bbc7bb tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Acquiring lock "cinder-quobyte-f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fe156909-90a7-4434-9799-f06f81bbc7bb tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Lock "cinder-quobyte-f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48" acquired by "delete_volume" :: waited 0.014s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:48 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[50227e3e-e355-4edd-9e75-cb0011fd880f]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:10:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fe156909-90a7-4434-9799-f06f81bbc7bb tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:48 devstack sudo[87435]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-aecebcf8-eddf-474b-a20e-48df131a928f tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e3eb020b-0171-495d-aed2-d1236750443e" returned: 0 in 0.819s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-aecebcf8-eddf-474b-a20e-48df131a928f tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e3eb020b-0171-495d-aed2-d1236750443e {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:48 devstack sudo[87440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48 Apr 27 10:10:48 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:48 devstack sudo[87441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e3eb020b-0171-495d-aed2-d1236750443e Apr 27 10:10:48 devstack sudo[87441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:48 devstack sudo[87441]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-aecebcf8-eddf-474b-a20e-48df131a928f tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e3eb020b-0171-495d-aed2-d1236750443e" returned: 0 in 0.472s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-aecebcf8-eddf-474b-a20e-48df131a928f tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "cinder-quobyte-e3eb020b-0171-495d-aed2-d1236750443e" released by "delete_volume" :: held 1.345s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:48 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-aecebcf8-eddf-474b-a20e-48df131a928f tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Created reservations ['a1b8124c-64c8-4ec9-86f9-5faf56991506', 'fbc0007b-a2a0-4769-a3b4-05d34da5da25', '7219737e-6da7-4950-acde-9d94d80299c4', '486d1347-4a8c-4d43-81ee-b822cfacb288'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:10:48 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-aecebcf8-eddf-474b-a20e-48df131a928f tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-aecebcf8-eddf-474b-a20e-48df131a928f tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-aecebcf8-eddf-474b-a20e-48df131a928f tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-aecebcf8-eddf-474b-a20e-48df131a928f tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-aecebcf8-eddf-474b-a20e-48df131a928f tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-aecebcf8-eddf-474b-a20e-48df131a928f tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fe156909-90a7-4434-9799-f06f81bbc7bb tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48" returned: 0 in 0.707s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fe156909-90a7-4434-9799-f06f81bbc7bb tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:48 devstack sudo[87463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48 Apr 27 10:10:48 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:48 devstack sudo[87462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:10:48 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:49 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-aecebcf8-eddf-474b-a20e-48df131a928f tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.518s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:49 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-aecebcf8-eddf-474b-a20e-48df131a928f tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:10:49 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-aecebcf8-eddf-474b-a20e-48df131a928f tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Deleted volume successfully. Apr 27 10:10:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-aecebcf8-eddf-474b-a20e-48df131a928f tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "cinder-e3eb020b-0171-495d-aed2-d1236750443e-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:49 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fe156909-90a7-4434-9799-f06f81bbc7bb tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48" returned: 0 in 0.559s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fe156909-90a7-4434-9799-f06f81bbc7bb tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Lock "cinder-quobyte-f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48" released by "delete_volume" :: held 1.312s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:49 devstack cinder-volume[81350]: WARNING cinder.quota [None req-fe156909-90a7-4434-9799-f06f81bbc7bb tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:10:49 devstack cinder-volume[81350]: WARNING cinder.quota [None req-fe156909-90a7-4434-9799-f06f81bbc7bb tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:10:49 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-fe156909-90a7-4434-9799-f06f81bbc7bb tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Created reservations ['ad4dda86-a575-4dc8-a912-47ee7213a556', '6cec39b6-bf54-499a-9501-5119313969f9', '8c243be8-765b-4e5f-982c-79766dd0d916', '275ce45f-c4e4-46bc-ba48-e3d2287247ca'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:10:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-fe156909-90a7-4434-9799-f06f81bbc7bb tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-fe156909-90a7-4434-9799-f06f81bbc7bb tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:49 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-fe156909-90a7-4434-9799-f06f81bbc7bb tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:49 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-fe156909-90a7-4434-9799-f06f81bbc7bb tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-fe156909-90a7-4434-9799-f06f81bbc7bb tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fe156909-90a7-4434-9799-f06f81bbc7bb tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-96d01a61-762f-4aa8-82fb-61f9b57dd254 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "cinder-d36b16d3-cf20-4130-856b-db20bdbe76b7-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-96d01a61-762f-4aa8-82fb-61f9b57dd254 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "cinder-d36b16d3-cf20-4130-856b-db20bdbe76b7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:49 devstack sudo[87470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:10:49 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-96d01a61-762f-4aa8-82fb-61f9b57dd254 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "cinder-quobyte-d36b16d3-cf20-4130-856b-db20bdbe76b7" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-96d01a61-762f-4aa8-82fb-61f9b57dd254 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "cinder-quobyte-d36b16d3-cf20-4130-856b-db20bdbe76b7" acquired by "delete_volume" :: waited 0.015s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:49 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a75b17-3791-406d-9bd3-369735e0773a]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:10:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-96d01a61-762f-4aa8-82fb-61f9b57dd254 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d36b16d3-cf20-4130-856b-db20bdbe76b7 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:49 devstack sudo[87472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d36b16d3-cf20-4130-856b-db20bdbe76b7 Apr 27 10:10:49 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:49 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fe156909-90a7-4434-9799-f06f81bbc7bb tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.532s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:49 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-fe156909-90a7-4434-9799-f06f81bbc7bb tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:10:49 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-fe156909-90a7-4434-9799-f06f81bbc7bb tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Deleted volume successfully. Apr 27 10:10:50 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fe156909-90a7-4434-9799-f06f81bbc7bb tempest-VolumeRetypeWithoutMigrationTest-1541492670 None] Lock "cinder-f7cdfa8e-eee5-42ed-a996-5eb7cee9cf48-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:50 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-96d01a61-762f-4aa8-82fb-61f9b57dd254 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d36b16d3-cf20-4130-856b-db20bdbe76b7" returned: 0 in 0.671s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-96d01a61-762f-4aa8-82fb-61f9b57dd254 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d36b16d3-cf20-4130-856b-db20bdbe76b7 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:50 devstack sudo[87478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d36b16d3-cf20-4130-856b-db20bdbe76b7 Apr 27 10:10:50 devstack sudo[87478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:50 devstack sudo[87478]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-96d01a61-762f-4aa8-82fb-61f9b57dd254 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d36b16d3-cf20-4130-856b-db20bdbe76b7" returned: 0 in 0.543s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:50 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-96d01a61-762f-4aa8-82fb-61f9b57dd254 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "cinder-quobyte-d36b16d3-cf20-4130-856b-db20bdbe76b7" released by "delete_volume" :: held 1.264s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:50 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-96d01a61-762f-4aa8-82fb-61f9b57dd254 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Created reservations ['0b85a138-8131-4cb8-80b0-9d076c99a736', '11909f5d-2a65-4e2f-ae62-8e2af33111b5', '51426c7f-df53-4b75-9e83-5d3931471df0', '270f2d83-6f70-42cc-98a4-5f156fd2c311'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:10:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-96d01a61-762f-4aa8-82fb-61f9b57dd254 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-96d01a61-762f-4aa8-82fb-61f9b57dd254 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:51 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-96d01a61-762f-4aa8-82fb-61f9b57dd254 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:51 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-96d01a61-762f-4aa8-82fb-61f9b57dd254 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-96d01a61-762f-4aa8-82fb-61f9b57dd254 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-96d01a61-762f-4aa8-82fb-61f9b57dd254 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:51 devstack sudo[87481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:10:51 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:51 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-96d01a61-762f-4aa8-82fb-61f9b57dd254 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.591s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:51 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-96d01a61-762f-4aa8-82fb-61f9b57dd254 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:10:51 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-96d01a61-762f-4aa8-82fb-61f9b57dd254 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Deleted volume successfully. Apr 27 10:10:51 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-96d01a61-762f-4aa8-82fb-61f9b57dd254 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "cinder-d36b16d3-cf20-4130-856b-db20bdbe76b7-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:51 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d660f336-e4e0-460e-9dcb-eaead25dad0e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "cinder-c2a23cf7-0b88-4040-94a7-0ab548e2832d-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:51 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d660f336-e4e0-460e-9dcb-eaead25dad0e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "cinder-c2a23cf7-0b88-4040-94a7-0ab548e2832d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:51 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d660f336-e4e0-460e-9dcb-eaead25dad0e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "cinder-quobyte-c2a23cf7-0b88-4040-94a7-0ab548e2832d" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:51 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d660f336-e4e0-460e-9dcb-eaead25dad0e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "cinder-quobyte-c2a23cf7-0b88-4040-94a7-0ab548e2832d" acquired by "delete_volume" :: waited 0.023s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:51 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[19457148-eed5-4973-ac50-f3ab8b8cb263]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:10:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d660f336-e4e0-460e-9dcb-eaead25dad0e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c2a23cf7-0b88-4040-94a7-0ab548e2832d {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:51 devstack sudo[87484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c2a23cf7-0b88-4040-94a7-0ab548e2832d Apr 27 10:10:51 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:52 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d660f336-e4e0-460e-9dcb-eaead25dad0e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c2a23cf7-0b88-4040-94a7-0ab548e2832d" returned: 0 in 0.730s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d660f336-e4e0-460e-9dcb-eaead25dad0e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c2a23cf7-0b88-4040-94a7-0ab548e2832d {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:52 devstack sudo[87490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c2a23cf7-0b88-4040-94a7-0ab548e2832d Apr 27 10:10:52 devstack sudo[87490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:53 devstack sudo[87490]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d660f336-e4e0-460e-9dcb-eaead25dad0e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c2a23cf7-0b88-4040-94a7-0ab548e2832d" returned: 0 in 0.535s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:53 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d660f336-e4e0-460e-9dcb-eaead25dad0e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "cinder-quobyte-c2a23cf7-0b88-4040-94a7-0ab548e2832d" released by "delete_volume" :: held 1.317s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:53 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-d660f336-e4e0-460e-9dcb-eaead25dad0e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Created reservations ['77289475-23b8-48a6-8d0d-67aae08ce9cf', 'cd2121fb-1b3c-41d6-8ada-aed814c48ae5', '8a853fc9-1081-47ed-8287-72a5bca61f38', '1526c6cc-dd32-48da-8cb1-bd494564fa1e'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:10:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d660f336-e4e0-460e-9dcb-eaead25dad0e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d660f336-e4e0-460e-9dcb-eaead25dad0e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d660f336-e4e0-460e-9dcb-eaead25dad0e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d660f336-e4e0-460e-9dcb-eaead25dad0e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d660f336-e4e0-460e-9dcb-eaead25dad0e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d660f336-e4e0-460e-9dcb-eaead25dad0e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:53 devstack sudo[87493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:10:53 devstack sudo[87493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:53 devstack sudo[87493]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d660f336-e4e0-460e-9dcb-eaead25dad0e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.637s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:53 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-d660f336-e4e0-460e-9dcb-eaead25dad0e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:10:53 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-d660f336-e4e0-460e-9dcb-eaead25dad0e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Deleted volume successfully. Apr 27 10:10:53 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d660f336-e4e0-460e-9dcb-eaead25dad0e tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "cinder-c2a23cf7-0b88-4040-94a7-0ab548e2832d-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:54 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-33fc722d-480d-4011-931a-2e5731ad54b9 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "cinder-f02fb333-02b2-48ae-8993-05572fc5ba60-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:54 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-33fc722d-480d-4011-931a-2e5731ad54b9 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "cinder-f02fb333-02b2-48ae-8993-05572fc5ba60-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:54 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-33fc722d-480d-4011-931a-2e5731ad54b9 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "cinder-quobyte-f02fb333-02b2-48ae-8993-05572fc5ba60" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:54 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-33fc722d-480d-4011-931a-2e5731ad54b9 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "cinder-quobyte-f02fb333-02b2-48ae-8993-05572fc5ba60" acquired by "delete_volume" :: waited 0.014s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:54 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf73f9b-9b75-46d1-b6e9-68c0d0c38bb1]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:10:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-33fc722d-480d-4011-931a-2e5731ad54b9 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f02fb333-02b2-48ae-8993-05572fc5ba60 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:54 devstack sudo[87500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f02fb333-02b2-48ae-8993-05572fc5ba60 Apr 27 10:10:54 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:54 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-33fc722d-480d-4011-931a-2e5731ad54b9 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f02fb333-02b2-48ae-8993-05572fc5ba60" returned: 0 in 0.800s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-33fc722d-480d-4011-931a-2e5731ad54b9 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f02fb333-02b2-48ae-8993-05572fc5ba60 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:54 devstack sudo[87509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f02fb333-02b2-48ae-8993-05572fc5ba60 Apr 27 10:10:54 devstack sudo[87509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:55 devstack sudo[87509]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-33fc722d-480d-4011-931a-2e5731ad54b9 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f02fb333-02b2-48ae-8993-05572fc5ba60" returned: 0 in 0.607s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:55 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-33fc722d-480d-4011-931a-2e5731ad54b9 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "cinder-quobyte-f02fb333-02b2-48ae-8993-05572fc5ba60" released by "delete_volume" :: held 1.480s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:55 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-33fc722d-480d-4011-931a-2e5731ad54b9 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Created reservations ['7c363cd2-50a1-4065-91a1-c3e336646f19', 'bc6fe237-4378-48c1-8ed4-709c175a9488', '179d8465-d6f5-4de2-8e15-daaa7e0c8897', 'a6f4874e-df82-44fe-9068-aff17491aacb'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:10:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-33fc722d-480d-4011-931a-2e5731ad54b9 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-33fc722d-480d-4011-931a-2e5731ad54b9 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:55 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-33fc722d-480d-4011-931a-2e5731ad54b9 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:55 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-33fc722d-480d-4011-931a-2e5731ad54b9 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-33fc722d-480d-4011-931a-2e5731ad54b9 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-33fc722d-480d-4011-931a-2e5731ad54b9 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:55 devstack sudo[87554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:10:55 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:56 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a9d718a1-3e2f-4fe1-bd0c-c9d8cac741f5 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "cinder-9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:56 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a9d718a1-3e2f-4fe1-bd0c-c9d8cac741f5 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "cinder-9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:56 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a9d718a1-3e2f-4fe1-bd0c-c9d8cac741f5 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "cinder-quobyte-9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:56 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a9d718a1-3e2f-4fe1-bd0c-c9d8cac741f5 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "cinder-quobyte-9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86" acquired by "delete_volume" :: waited 0.030s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:56 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[721523ac-bd83-454f-979e-5fa07d2f3692]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:10:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a9d718a1-3e2f-4fe1-bd0c-c9d8cac741f5 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:56 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-33fc722d-480d-4011-931a-2e5731ad54b9 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 1.017s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:56 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-33fc722d-480d-4011-931a-2e5731ad54b9 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:10:56 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-33fc722d-480d-4011-931a-2e5731ad54b9 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Deleted volume successfully. Apr 27 10:10:56 devstack sudo[87576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86 Apr 27 10:10:56 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:56 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-33fc722d-480d-4011-931a-2e5731ad54b9 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "cinder-f02fb333-02b2-48ae-8993-05572fc5ba60-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:56 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:10:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Flow 'volume_create_manager' (96395587-1737-4c3a-81e2-c214cb543eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:10:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b8ea3e-e340-411f-8996-b54a76d972dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b8ea3e-e340-411f-8996-b54a76d972dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1021339859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07e052a9-a28b-4ed5-997c-123cb2cef6c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23053f19ecf4472a422f692e1f99679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:10:57Z,use_quota=True,user_id='7c197063006240e19449e13214d8e2fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (581db39b-447d-4952-bb1f-fabc82abe111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (581db39b-447d-4952-bb1f-fabc82abe111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ba1df9-a1d9-4b6c-b111-51aeac0363ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ba1df9-a1d9-4b6c-b111-51aeac0363ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07e052a9-a28b-4ed5-997c-123cb2cef6c3', 'volume_name': 'volume-07e052a9-a28b-4ed5-997c-123cb2cef6c3', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdff480b-c17b-44e0-b494-b85625044b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdff480b-c17b-44e0-b494-b85625044b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4019df40-2d2d-4e8d-a140-9f8d3693fcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:57 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Volume 07e052a9-a28b-4ed5-997c-123cb2cef6c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07e052a9-a28b-4ed5-997c-123cb2cef6c3', 'volume_size': 1} Apr 27 10:10:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1021339859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07e052a9-a28b-4ed5-997c-123cb2cef6c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23053f19ecf4472a422f692e1f99679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:10:57Z,use_quota=True,user_id='7c197063006240e19449e13214d8e2fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:10:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Creating volume 07e052a9-a28b-4ed5-997c-123cb2cef6c3 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:10:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:10:57 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:10:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-07e052a9-a28b-4ed5-997c-123cb2cef6c3 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:57 devstack sudo[87593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-07e052a9-a28b-4ed5-997c-123cb2cef6c3 1073741824 Apr 27 10:10:57 devstack sudo[87593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:57 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a9d718a1-3e2f-4fe1-bd0c-c9d8cac741f5 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86" returned: 0 in 1.199s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a9d718a1-3e2f-4fe1-bd0c-c9d8cac741f5 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:57 devstack sudo[87600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86 Apr 27 10:10:57 devstack sudo[87600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:58 devstack sudo[87593]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-07e052a9-a28b-4ed5-997c-123cb2cef6c3 1073741824" returned: 0 in 1.118s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-07e052a9-a28b-4ed5-997c-123cb2cef6c3 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:58 devstack sudo[87605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-07e052a9-a28b-4ed5-997c-123cb2cef6c3 Apr 27 10:10:58 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:58 devstack sudo[87600]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a9d718a1-3e2f-4fe1-bd0c-c9d8cac741f5 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86" returned: 0 in 0.660s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:58 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a9d718a1-3e2f-4fe1-bd0c-c9d8cac741f5 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "cinder-quobyte-9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86" released by "delete_volume" :: held 1.936s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:58 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-a9d718a1-3e2f-4fe1-bd0c-c9d8cac741f5 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Created reservations ['c05e95e1-2b2e-4632-83e4-b22e8251f2fd', 'a7bbfd77-717f-4dca-9aac-a03b6dbb809f', '105db557-3090-4b4b-9487-e5afcef39a49', 'e9c084be-c5fc-47d8-8d8c-7ffb4ab1fa31'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:10:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-a9d718a1-3e2f-4fe1-bd0c-c9d8cac741f5 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:10:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-a9d718a1-3e2f-4fe1-bd0c-c9d8cac741f5 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:10:58 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-a9d718a1-3e2f-4fe1-bd0c-c9d8cac741f5 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:10:58 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-a9d718a1-3e2f-4fe1-bd0c-c9d8cac741f5 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:10:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-a9d718a1-3e2f-4fe1-bd0c-c9d8cac741f5 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a9d718a1-3e2f-4fe1-bd0c-c9d8cac741f5 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:10:58 devstack sudo[87608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:10:58 devstack sudo[87608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:10:58 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-07e052a9-a28b-4ed5-997c-123cb2cef6c3" returned: 0 in 0.591s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:58 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:10:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:10:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4019df40-2d2d-4e8d-a140-9f8d3693fcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07e052a9-a28b-4ed5-997c-123cb2cef6c3', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73257ace-88e7-46f4-be6d-e30fb42cb739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:10:58 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Volume volume-07e052a9-a28b-4ed5-997c-123cb2cef6c3 (07e052a9-a28b-4ed5-997c-123cb2cef6c3): created successfully Apr 27 10:10:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73257ace-88e7-46f4-be6d-e30fb42cb739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:10:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Flow 'volume_create_manager' (96395587-1737-4c3a-81e2-c214cb543eca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:10:58 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-c6a5fbba-e23e-4815-b507-07b7840828b5 tempest-VolumesListAdminTestJSON-384115257 None] Created volume successfully. Apr 27 10:10:59 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a431cb15-ddff-433b-bce3-35ed0634d2f5 tempest-VolumesActionsTest-1292551954 None] Acquiring lock "cinder-ad382ce3-d94a-434d-9a6c-13957956a23b" by "attach_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:10:59 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a431cb15-ddff-433b-bce3-35ed0634d2f5 tempest-VolumesActionsTest-1292551954 None] Lock "cinder-ad382ce3-d94a-434d-9a6c-13957956a23b" acquired by "attach_volume" :: waited 0.023s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:10:59 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-a431cb15-ddff-433b-bce3-35ed0634d2f5 tempest-VolumesActionsTest-1292551954 None] Attaching volume ad382ce3-d94a-434d-9a6c-13957956a23b to instance dd584856-1d08-4f24-9fc5-900a210254d8 at mountpoint /dev/vdb on host None. Apr 27 10:10:59 devstack sudo[87608]: pam_unix(sudo:session): session closed for user root Apr 27 10:10:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a9d718a1-3e2f-4fe1-bd0c-c9d8cac741f5 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.860s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:10:59 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-a9d718a1-3e2f-4fe1-bd0c-c9d8cac741f5 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:10:59 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-a9d718a1-3e2f-4fe1-bd0c-c9d8cac741f5 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Deleted volume successfully. Apr 27 10:10:59 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-a431cb15-ddff-433b-bce3-35ed0634d2f5 tempest-VolumesActionsTest-1292551954 None] Attach volume completed successfully. Apr 27 10:10:59 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a431cb15-ddff-433b-bce3-35ed0634d2f5 tempest-VolumesActionsTest-1292551954 None] Lock "cinder-ad382ce3-d94a-434d-9a6c-13957956a23b" released by "attach_volume" :: held 0.145s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:59 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a9d718a1-3e2f-4fe1-bd0c-c9d8cac741f5 tempest-CreateVolumesFromSourceVolumeTest-1525610802 None] Lock "cinder-9fd48dc5-96c5-4ed7-8f0c-72c902fa9d86-delete_volume" released by "delete_volume" :: held 3.076s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:10:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ed10a822-3d4b-4789-9ec0-70934d94d48c tempest-BackendsCapabilitiesAdminTestsJSON-2027723800 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309875488281, 'free_capacity_gb': 1775.7309875488281, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81350) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d5b3bf3f-1268-427b-9115-d6fe9bf9d6a8 tempest-VolumesActionsTest-1292551954 None] Acquiring lock "cinder-ad382ce3-d94a-434d-9a6c-13957956a23b-detach_volume" by "detach_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d5b3bf3f-1268-427b-9115-d6fe9bf9d6a8 tempest-VolumesActionsTest-1292551954 None] Lock "cinder-ad382ce3-d94a-434d-9a6c-13957956a23b-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:11:00 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-d5b3bf3f-1268-427b-9115-d6fe9bf9d6a8 tempest-VolumesActionsTest-1292551954 None] Detaching volume ad382ce3-d94a-434d-9a6c-13957956a23b from instance dd584856-1d08-4f24-9fc5-900a210254d8. Apr 27 10:11:00 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-d5b3bf3f-1268-427b-9115-d6fe9bf9d6a8 tempest-VolumesActionsTest-1292551954 None] Detach volume completed successfully. Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d5b3bf3f-1268-427b-9115-d6fe9bf9d6a8 tempest-VolumesActionsTest-1292551954 None] Lock "cinder-ad382ce3-d94a-434d-9a6c-13957956a23b-detach_volume" released by "detach_volume" :: held 0.079s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-a009a801-75a5-415a-a38b-722fed6b9960 tempest-BackendsCapabilitiesAdminTestsJSON-2027723800 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309875488281, 'free_capacity_gb': 1775.7309875488281, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81350) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Flow 'volume_create_manager' (a5ccde3f-0e19-4680-921d-d936755509de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a246f1d6-0568-48f0-9bc9-e00334d86afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a246f1d6-0568-48f0-9bc9-e00334d86afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1953521864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c436676-de7f-47eb-b2ee-b32b3c450d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23053f19ecf4472a422f692e1f99679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:11:01Z,use_quota=True,user_id='7c197063006240e19449e13214d8e2fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd86efab-a414-4bfd-8a60-283b40c3b323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd86efab-a414-4bfd-8a60-283b40c3b323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4db343f-91b7-43a8-a1c7-66188b92d387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4db343f-91b7-43a8-a1c7-66188b92d387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c436676-de7f-47eb-b2ee-b32b3c450d46', 'volume_name': 'volume-7c436676-de7f-47eb-b2ee-b32b3c450d46', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5087cfd-dd20-4701-8f10-7b891304bbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5087cfd-dd20-4701-8f10-7b891304bbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af7aef9-f4ef-4bd9-a6b2-33afcf7b6db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:00 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Volume 7c436676-de7f-47eb-b2ee-b32b3c450d46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c436676-de7f-47eb-b2ee-b32b3c450d46', 'volume_size': 1} Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1953521864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c436676-de7f-47eb-b2ee-b32b3c450d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23053f19ecf4472a422f692e1f99679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:11:01Z,use_quota=True,user_id='7c197063006240e19449e13214d8e2fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Creating volume 7c436676-de7f-47eb-b2ee-b32b3c450d46 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:11:00 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:11:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7c436676-de7f-47eb-b2ee-b32b3c450d46 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:00 devstack sudo[87612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7c436676-de7f-47eb-b2ee-b32b3c450d46 1073741824 Apr 27 10:11:00 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:01 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7c436676-de7f-47eb-b2ee-b32b3c450d46 1073741824" returned: 0 in 0.855s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7c436676-de7f-47eb-b2ee-b32b3c450d46 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:01 devstack sudo[87618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7c436676-de7f-47eb-b2ee-b32b3c450d46 Apr 27 10:11:01 devstack sudo[87618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:02 devstack sudo[87618]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7c436676-de7f-47eb-b2ee-b32b3c450d46" returned: 0 in 0.754s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:11:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af7aef9-f4ef-4bd9-a6b2-33afcf7b6db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c436676-de7f-47eb-b2ee-b32b3c450d46', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90bb4a19-c8a8-43d8-90c3-bd7149f87f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:02 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Volume volume-7c436676-de7f-47eb-b2ee-b32b3c450d46 (7c436676-de7f-47eb-b2ee-b32b3c450d46): created successfully Apr 27 10:11:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90bb4a19-c8a8-43d8-90c3-bd7149f87f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Flow 'volume_create_manager' (a5ccde3f-0e19-4680-921d-d936755509de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:11:02 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-15785045-acbb-4d38-b3a8-2353cfe113d2 tempest-VolumesListAdminTestJSON-384115257 None] Created volume successfully. Apr 27 10:11:03 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:11:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Flow 'volume_create_manager' (abb4461f-58bc-4ae8-b2f7-e3b2d063172d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:11:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d406cc77-a4a9-4528-a9e2-80daa896d598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d406cc77-a4a9-4528-a9e2-80daa896d598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-618119504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d97682-af52-41f8-99fb-293148bfda08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23053f19ecf4472a422f692e1f99679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:11:03Z,use_quota=True,user_id='7c197063006240e19449e13214d8e2fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb600adb-02ed-41e0-a7f1-39c14b519be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb600adb-02ed-41e0-a7f1-39c14b519be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa693402-a36a-4ae2-a0f6-240b634846eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa693402-a36a-4ae2-a0f6-240b634846eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1d97682-af52-41f8-99fb-293148bfda08', 'volume_name': 'volume-a1d97682-af52-41f8-99fb-293148bfda08', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e9c6a0-2b67-4d90-9d76-c7d0301be2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e9c6a0-2b67-4d90-9d76-c7d0301be2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db9a60ec-640c-4792-96d9-a4d63ab6bb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:03 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Volume a1d97682-af52-41f8-99fb-293148bfda08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1d97682-af52-41f8-99fb-293148bfda08', 'volume_size': 1} Apr 27 10:11:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-618119504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d97682-af52-41f8-99fb-293148bfda08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23053f19ecf4472a422f692e1f99679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:11:03Z,use_quota=True,user_id='7c197063006240e19449e13214d8e2fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:11:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Creating volume a1d97682-af52-41f8-99fb-293148bfda08 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:11:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:11:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:11:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:11:03 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:11:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a1d97682-af52-41f8-99fb-293148bfda08 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:03 devstack sudo[87652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a1d97682-af52-41f8-99fb-293148bfda08 1073741824 Apr 27 10:11:03 devstack sudo[87652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:03 devstack sudo[87652]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a1d97682-af52-41f8-99fb-293148bfda08 1073741824" returned: 0 in 0.698s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a1d97682-af52-41f8-99fb-293148bfda08 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:04 devstack sudo[87658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a1d97682-af52-41f8-99fb-293148bfda08 Apr 27 10:11:04 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:04 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a1d97682-af52-41f8-99fb-293148bfda08" returned: 0 in 0.551s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:04 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:11:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:04 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db9a60ec-640c-4792-96d9-a4d63ab6bb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1d97682-af52-41f8-99fb-293148bfda08', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:04 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1b3725-b841-4fc2-b3e4-10f3161b1c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:04 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Volume volume-a1d97682-af52-41f8-99fb-293148bfda08 (a1d97682-af52-41f8-99fb-293148bfda08): created successfully Apr 27 10:11:04 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1b3725-b841-4fc2-b3e4-10f3161b1c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:04 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Flow 'volume_create_manager' (abb4461f-58bc-4ae8-b2f7-e3b2d063172d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:11:04 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-72c79dca-0fd7-4635-8c90-b9a48f4e5494 tempest-VolumesListAdminTestJSON-384115257 None] Created volume successfully. Apr 27 10:11:06 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-1454e9df-d183-4d9f-beb8-3a0059d6806e tempest-GroupSnapshotsTest-2035960321 None] Group tempest-GroupSnapshotsTest-Group-561563651: creating Apr 27 10:11:06 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:11:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Flow 'volume_create_manager' (a612b6c1-7aff-487b-be54-e23aa68cf0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:11:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb228b43-1765-4a0f-bfbd-2b1b71d96937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:06 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-1454e9df-d183-4d9f-beb8-3a0059d6806e tempest-GroupSnapshotsTest-2035960321 None] Group tempest-GroupSnapshotsTest-Group-561563651: created successfully Apr 27 10:11:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb228b43-1765-4a0f-bfbd-2b1b71d96937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69467257-2301-4c49-9360-a123ca644524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a230cd16e548069ee473774d2da028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:11:06Z,use_quota=True,user_id='2688769f69ee411198cd4e1063e28d77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33ec0af6-76ee-49e0-b5b2-21edcf5a894d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33ec0af6-76ee-49e0-b5b2-21edcf5a894d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378c2a47-c009-4977-9262-545816d8646d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378c2a47-c009-4977-9262-545816d8646d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69467257-2301-4c49-9360-a123ca644524', 'volume_name': 'volume-69467257-2301-4c49-9360-a123ca644524', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3046f924-89df-48af-82f2-1d167a1d9bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3046f924-89df-48af-82f2-1d167a1d9bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28399115-1893-4bba-b274-32e8bf87f747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:06 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Volume 69467257-2301-4c49-9360-a123ca644524: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69467257-2301-4c49-9360-a123ca644524', 'volume_size': 1} Apr 27 10:11:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:06 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69467257-2301-4c49-9360-a123ca644524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a230cd16e548069ee473774d2da028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:11:06Z,use_quota=True,user_id='2688769f69ee411198cd4e1063e28d77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:11:06 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Creating volume 69467257-2301-4c49-9360-a123ca644524 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:11:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:06 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:11:06 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:11:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:06 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:11:06 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:11:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69467257-2301-4c49-9360-a123ca644524 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:06 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-1454e9df-d183-4d9f-beb8-3a0059d6806e tempest-GroupSnapshotsTest-2035960321 None] Create group completed successfully. Apr 27 10:11:06 devstack sudo[87666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69467257-2301-4c49-9360-a123ca644524 1073741824 Apr 27 10:11:06 devstack sudo[87666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:06 devstack sudo[87666]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69467257-2301-4c49-9360-a123ca644524 1073741824" returned: 0 in 0.646s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69467257-2301-4c49-9360-a123ca644524 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:06 devstack sudo[87671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69467257-2301-4c49-9360-a123ca644524 Apr 27 10:11:06 devstack sudo[87671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:07 devstack sudo[87671]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69467257-2301-4c49-9360-a123ca644524" returned: 0 in 0.533s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28399115-1893-4bba-b274-32e8bf87f747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69467257-2301-4c49-9360-a123ca644524', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c213055-bd3a-4c67-a897-f8658975db3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:07 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Volume volume-69467257-2301-4c49-9360-a123ca644524 (69467257-2301-4c49-9360-a123ca644524): created successfully Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c213055-bd3a-4c67-a897-f8658975db3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Flow 'volume_create_manager' (a612b6c1-7aff-487b-be54-e23aa68cf0a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:11:07 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-b8d0f9d8-b9c5-4e61-a16d-d03ee20ff2af tempest-VolumesListAdminTestJSON-1191753674 None] Created volume successfully. Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Flow 'volume_create_manager' (02447d8c-05c6-4802-a7a7-01701d03b314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61c6ce06-9169-486b-9826-19f887cbe0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61c6ce06-9169-486b-9826-19f887cbe0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-225002311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=33e35f88-c44c-4d38-a0b2-7ed6f79f8858,host='devstack@QuobyteHD#QuobyteHD',id=56e9f1a9-a9e8-400e-b5de-f795f98d1f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339a6b64c6b94ca98cef7fcca0a2f4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:11:07Z,use_quota=True,user_id='29c0afff810a4c0387dee9391a78ef21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80563782-6cf4-4427-9cba-ca7bdc5ff816),volume_type_id=80563782-6cf4-4427-9cba-ca7bdc5ff816)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (145605d1-bf48-4d6d-a753-fab2be51cdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (145605d1-bf48-4d6d-a753-fab2be51cdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe0ee4e-5a9c-406c-8122-b5cb8b0a36b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe0ee4e-5a9c-406c-8122-b5cb8b0a36b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56e9f1a9-a9e8-400e-b5de-f795f98d1f52', 'volume_name': 'volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43dc9a2b-abd4-4e25-96dd-9e2a71dd3d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43dc9a2b-abd4-4e25-96dd-9e2a71dd3d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa40dab-dd6a-4cb1-bb6b-c4dba1b3db24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:07 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Volume 56e9f1a9-a9e8-400e-b5de-f795f98d1f52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52', 'volume_size': 1} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=33e35f88-c44c-4d38-a0b2-7ed6f79f8858,created_at=2026-04-27T08:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-225002311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=33e35f88-c44c-4d38-a0b2-7ed6f79f8858,host='devstack@QuobyteHD#QuobyteHD',id=56e9f1a9-a9e8-400e-b5de-f795f98d1f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339a6b64c6b94ca98cef7fcca0a2f4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:11:07Z,use_quota=True,user_id='29c0afff810a4c0387dee9391a78ef21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80563782-6cf4-4427-9cba-ca7bdc5ff816),volume_type_id=80563782-6cf4-4427-9cba-ca7bdc5ff816)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Creating volume 56e9f1a9-a9e8-400e-b5de-f795f98d1f52 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:11:07 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:11:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:07 devstack sudo[87674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 1073741824 Apr 27 10:11:07 devstack sudo[87674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:08 devstack sudo[87674]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 1073741824" returned: 0 in 0.645s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:08 devstack sudo[87679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 Apr 27 10:11:08 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-81648f8b-e487-400d-a040-c93139ab0873 tempest-VolumesListAdminTestJSON-1191753674 None] Acquiring lock "cinder-69467257-2301-4c49-9360-a123ca644524-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:11:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-81648f8b-e487-400d-a040-c93139ab0873 tempest-VolumesListAdminTestJSON-1191753674 None] Lock "cinder-69467257-2301-4c49-9360-a123ca644524-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:11:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-81648f8b-e487-400d-a040-c93139ab0873 tempest-VolumesListAdminTestJSON-1191753674 None] Acquiring lock "cinder-quobyte-69467257-2301-4c49-9360-a123ca644524" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:11:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-81648f8b-e487-400d-a040-c93139ab0873 tempest-VolumesListAdminTestJSON-1191753674 None] Lock "cinder-quobyte-69467257-2301-4c49-9360-a123ca644524" acquired by "delete_volume" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:11:08 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d51246-f969-4868-bf29-38f07aecb66b]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-81648f8b-e487-400d-a040-c93139ab0873 tempest-VolumesListAdminTestJSON-1191753674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69467257-2301-4c49-9360-a123ca644524 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:08 devstack sudo[87681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69467257-2301-4c49-9360-a123ca644524 Apr 27 10:11:08 devstack sudo[87681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8bc36ab1-9a2e-4f07-8473-ff691bf6243c tempest-VolumesListAdminTestJSON-384115257 None] Acquiring lock "cinder-a1d97682-af52-41f8-99fb-293148bfda08-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:11:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8bc36ab1-9a2e-4f07-8473-ff691bf6243c tempest-VolumesListAdminTestJSON-384115257 None] Lock "cinder-a1d97682-af52-41f8-99fb-293148bfda08-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:11:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8bc36ab1-9a2e-4f07-8473-ff691bf6243c tempest-VolumesListAdminTestJSON-384115257 None] Acquiring lock "cinder-quobyte-a1d97682-af52-41f8-99fb-293148bfda08" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:11:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8bc36ab1-9a2e-4f07-8473-ff691bf6243c tempest-VolumesListAdminTestJSON-384115257 None] Lock "cinder-quobyte-a1d97682-af52-41f8-99fb-293148bfda08" acquired by "delete_volume" :: waited 0.033s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:11:08 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[99621ef3-53df-495a-9888-c62ece917552]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8bc36ab1-9a2e-4f07-8473-ff691bf6243c tempest-VolumesListAdminTestJSON-384115257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a1d97682-af52-41f8-99fb-293148bfda08 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:08 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52" returned: 0 in 0.619s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:11:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa40dab-dd6a-4cb1-bb6b-c4dba1b3db24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882c3fee-18ad-4a83-9d37-76afe2f50ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:08 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Volume volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 (56e9f1a9-a9e8-400e-b5de-f795f98d1f52): created successfully Apr 27 10:11:08 devstack sudo[87684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a1d97682-af52-41f8-99fb-293148bfda08 Apr 27 10:11:08 devstack sudo[87684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882c3fee-18ad-4a83-9d37-76afe2f50ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Flow 'volume_create_manager' (02447d8c-05c6-4802-a7a7-01701d03b314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:11:08 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-ca31a482-2e60-4de7-86c1-20193365a6db tempest-GroupSnapshotsTest-2035960321 None] Created volume successfully. Apr 27 10:11:09 devstack sudo[87681]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-81648f8b-e487-400d-a040-c93139ab0873 tempest-VolumesListAdminTestJSON-1191753674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69467257-2301-4c49-9360-a123ca644524" returned: 0 in 0.674s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-81648f8b-e487-400d-a040-c93139ab0873 tempest-VolumesListAdminTestJSON-1191753674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69467257-2301-4c49-9360-a123ca644524 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:09 devstack sudo[87689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69467257-2301-4c49-9360-a123ca644524 Apr 27 10:11:09 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:09 devstack sudo[87684]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8bc36ab1-9a2e-4f07-8473-ff691bf6243c tempest-VolumesListAdminTestJSON-384115257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a1d97682-af52-41f8-99fb-293148bfda08" returned: 0 in 0.603s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8bc36ab1-9a2e-4f07-8473-ff691bf6243c tempest-VolumesListAdminTestJSON-384115257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a1d97682-af52-41f8-99fb-293148bfda08 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:09 devstack sudo[87694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a1d97682-af52-41f8-99fb-293148bfda08 Apr 27 10:11:09 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:09 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-81648f8b-e487-400d-a040-c93139ab0873 tempest-VolumesListAdminTestJSON-1191753674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69467257-2301-4c49-9360-a123ca644524" returned: 0 in 0.507s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:09 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-81648f8b-e487-400d-a040-c93139ab0873 tempest-VolumesListAdminTestJSON-1191753674 None] Lock "cinder-quobyte-69467257-2301-4c49-9360-a123ca644524" released by "delete_volume" :: held 1.222s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:11:09 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-81648f8b-e487-400d-a040-c93139ab0873 tempest-VolumesListAdminTestJSON-1191753674 None] Created reservations ['2226fed5-4550-43d4-8582-5f47aee32b5f', 'f672058e-81e8-447e-bb8c-1fc72ceeb40a', '220bd5ef-4c1d-4149-bd9f-cef327f51660', 'f536aff3-74d7-43da-b2b7-c07e8e69bf45'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:11:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-81648f8b-e487-400d-a040-c93139ab0873 tempest-VolumesListAdminTestJSON-1191753674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-81648f8b-e487-400d-a040-c93139ab0873 tempest-VolumesListAdminTestJSON-1191753674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:09 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-81648f8b-e487-400d-a040-c93139ab0873 tempest-VolumesListAdminTestJSON-1191753674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:11:09 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-81648f8b-e487-400d-a040-c93139ab0873 tempest-VolumesListAdminTestJSON-1191753674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:11:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-81648f8b-e487-400d-a040-c93139ab0873 tempest-VolumesListAdminTestJSON-1191753674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-81648f8b-e487-400d-a040-c93139ab0873 tempest-VolumesListAdminTestJSON-1191753674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:09 devstack sudo[87697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:11:09 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:09 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-ba385ac4-7fc1-4291-aef5-42f7351a28ee tempest-GroupSnapshotsTest-2035960321 None] GroupSnapshot 7c21b9c0-9f40-4635-8889-b808b95a35fb: creating. Apr 27 10:11:09 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8bc36ab1-9a2e-4f07-8473-ff691bf6243c tempest-VolumesListAdminTestJSON-384115257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a1d97682-af52-41f8-99fb-293148bfda08" returned: 0 in 0.536s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:10 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ba385ac4-7fc1-4291-aef5-42f7351a28ee tempest-GroupSnapshotsTest-2035960321 None] Group snapshot 7c21b9c0-9f40-4635-8889-b808b95a35fb: creating. {{(pid=81350) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 27 10:11:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ba385ac4-7fc1-4291-aef5-42f7351a28ee tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ba385ac4-7fc1-4291-aef5-42f7351a28ee tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8bc36ab1-9a2e-4f07-8473-ff691bf6243c tempest-VolumesListAdminTestJSON-384115257 None] Lock "cinder-quobyte-a1d97682-af52-41f8-99fb-293148bfda08" released by "delete_volume" :: held 1.211s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:11:10 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-ba385ac4-7fc1-4291-aef5-42f7351a28ee tempest-GroupSnapshotsTest-2035960321 None] Creating offline snapshot dacedd3c-6ca8-47d6-a417-9881cc01aaa9 of volume 56e9f1a9-a9e8-400e-b5de-f795f98d1f52 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:11:10 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[343d6d10-1c51-4de1-a1e0-f09cd80a5be3]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ba385ac4-7fc1-4291-aef5-42f7351a28ee tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:10 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-8bc36ab1-9a2e-4f07-8473-ff691bf6243c tempest-VolumesListAdminTestJSON-384115257 None] Created reservations ['7e27c35e-23ff-4188-9682-69d2353404a9', '34671fbb-a7b1-44db-b03e-1063ad574b45', 'b165ccc1-6364-427c-8413-1668fa0a5232', 'bccebbb5-986e-4ac8-b364-7d09eb3d140a'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:11:10 devstack sudo[87700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 Apr 27 10:11:10 devstack sudo[87700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0a9dfa78-8290-4dce-85d6-3b965da66922 tempest-VolumesActionsTest-1292551954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8bc36ab1-9a2e-4f07-8473-ff691bf6243c tempest-VolumesListAdminTestJSON-384115257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8bc36ab1-9a2e-4f07-8473-ff691bf6243c tempest-VolumesListAdminTestJSON-384115257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:10 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8bc36ab1-9a2e-4f07-8473-ff691bf6243c tempest-VolumesListAdminTestJSON-384115257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:11:10 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8bc36ab1-9a2e-4f07-8473-ff691bf6243c tempest-VolumesListAdminTestJSON-384115257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:11:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8bc36ab1-9a2e-4f07-8473-ff691bf6243c tempest-VolumesListAdminTestJSON-384115257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8bc36ab1-9a2e-4f07-8473-ff691bf6243c tempest-VolumesListAdminTestJSON-384115257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:10 devstack sudo[87703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:11:10 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:10 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-81648f8b-e487-400d-a040-c93139ab0873 tempest-VolumesListAdminTestJSON-1191753674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.549s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:10 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-81648f8b-e487-400d-a040-c93139ab0873 tempest-VolumesListAdminTestJSON-1191753674 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:11:10 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-81648f8b-e487-400d-a040-c93139ab0873 tempest-VolumesListAdminTestJSON-1191753674 None] Deleted volume successfully. Apr 27 10:11:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-81648f8b-e487-400d-a040-c93139ab0873 tempest-VolumesListAdminTestJSON-1191753674 None] Lock "cinder-69467257-2301-4c49-9360-a123ca644524-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:11:10 devstack sudo[87700]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ba385ac4-7fc1-4291-aef5-42f7351a28ee tempest-GroupSnapshotsTest-2035960321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52" returned: 0 in 0.557s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ba385ac4-7fc1-4291-aef5-42f7351a28ee tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.dacedd3c-6ca8-47d6-a417-9881cc01aaa9 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:10 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:10 devstack sudo[87709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.dacedd3c-6ca8-47d6-a417-9881cc01aaa9 1G Apr 27 10:11:10 devstack sudo[87709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8bc36ab1-9a2e-4f07-8473-ff691bf6243c tempest-VolumesListAdminTestJSON-384115257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.439s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:10 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-8bc36ab1-9a2e-4f07-8473-ff691bf6243c tempest-VolumesListAdminTestJSON-384115257 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:11:10 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-8bc36ab1-9a2e-4f07-8473-ff691bf6243c tempest-VolumesListAdminTestJSON-384115257 None] Deleted volume successfully. Apr 27 10:11:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8bc36ab1-9a2e-4f07-8473-ff691bf6243c tempest-VolumesListAdminTestJSON-384115257 None] Lock "cinder-a1d97682-af52-41f8-99fb-293148bfda08-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:11:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5cc79712-cc1e-4c15-a77d-3304c359b7eb tempest-VolumesListAdminTestJSON-384115257 None] Acquiring lock "cinder-7c436676-de7f-47eb-b2ee-b32b3c450d46-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:11:11 devstack sudo[87709]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5cc79712-cc1e-4c15-a77d-3304c359b7eb tempest-VolumesListAdminTestJSON-384115257 None] Lock "cinder-7c436676-de7f-47eb-b2ee-b32b3c450d46-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:11:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ba385ac4-7fc1-4291-aef5-42f7351a28ee tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.dacedd3c-6ca8-47d6-a417-9881cc01aaa9 1G" returned: 0 in 0.606s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ba385ac4-7fc1-4291-aef5-42f7351a28ee tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.dacedd3c-6ca8-47d6-a417-9881cc01aaa9 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:11 devstack sudo[87714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.dacedd3c-6ca8-47d6-a417-9881cc01aaa9 Apr 27 10:11:11 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5cc79712-cc1e-4c15-a77d-3304c359b7eb tempest-VolumesListAdminTestJSON-384115257 None] Acquiring lock "cinder-quobyte-7c436676-de7f-47eb-b2ee-b32b3c450d46" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:11:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5cc79712-cc1e-4c15-a77d-3304c359b7eb tempest-VolumesListAdminTestJSON-384115257 None] Lock "cinder-quobyte-7c436676-de7f-47eb-b2ee-b32b3c450d46" acquired by "delete_volume" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:11:11 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8a0331-e500-43b4-a166-a929db624a94]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5cc79712-cc1e-4c15-a77d-3304c359b7eb tempest-VolumesListAdminTestJSON-384115257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7c436676-de7f-47eb-b2ee-b32b3c450d46 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:11 devstack sudo[87716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7c436676-de7f-47eb-b2ee-b32b3c450d46 Apr 27 10:11:11 devstack sudo[87716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:11 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ba385ac4-7fc1-4291-aef5-42f7351a28ee tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.dacedd3c-6ca8-47d6-a417-9881cc01aaa9" returned: 0 in 0.494s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:11 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-ba385ac4-7fc1-4291-aef5-42f7351a28ee tempest-GroupSnapshotsTest-2035960321 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.dacedd3c-6ca8-47d6-a417-9881cc01aaa9 is being set with open permissions: ugo+rw: NotImplementedError Apr 27 10:11:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ba385ac4-7fc1-4291-aef5-42f7351a28ee tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.dacedd3c-6ca8-47d6-a417-9881cc01aaa9 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:11 devstack sudo[87723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.dacedd3c-6ca8-47d6-a417-9881cc01aaa9 Apr 27 10:11:11 devstack sudo[87723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:11 devstack sudo[87716]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5cc79712-cc1e-4c15-a77d-3304c359b7eb tempest-VolumesListAdminTestJSON-384115257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7c436676-de7f-47eb-b2ee-b32b3c450d46" returned: 0 in 0.524s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5cc79712-cc1e-4c15-a77d-3304c359b7eb tempest-VolumesListAdminTestJSON-384115257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7c436676-de7f-47eb-b2ee-b32b3c450d46 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:11 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7c436676-de7f-47eb-b2ee-b32b3c450d46 Apr 27 10:11:11 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:12 devstack sudo[87723]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ba385ac4-7fc1-4291-aef5-42f7351a28ee tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.dacedd3c-6ca8-47d6-a417-9881cc01aaa9" returned: 0 in 0.440s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ba385ac4-7fc1-4291-aef5-42f7351a28ee tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:12 devstack sudo[87730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.info Apr 27 10:11:12 devstack sudo[87730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:12 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5cc79712-cc1e-4c15-a77d-3304c359b7eb tempest-VolumesListAdminTestJSON-384115257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7c436676-de7f-47eb-b2ee-b32b3c450d46" returned: 0 in 0.471s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:12 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5cc79712-cc1e-4c15-a77d-3304c359b7eb tempest-VolumesListAdminTestJSON-384115257 None] Lock "cinder-quobyte-7c436676-de7f-47eb-b2ee-b32b3c450d46" released by "delete_volume" :: held 1.035s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:11:12 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-5cc79712-cc1e-4c15-a77d-3304c359b7eb tempest-VolumesListAdminTestJSON-384115257 None] Created reservations ['07482ec9-1505-4626-ada9-65ef3beb49cd', 'c473cb78-5bf0-45a5-9e3f-47a8097627dc', '28fa1e6b-d5ca-4119-8d5c-793446eba084', 'ae1a8bd0-e041-4e6c-9f0d-8f48793a64e6'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:11:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5cc79712-cc1e-4c15-a77d-3304c359b7eb tempest-VolumesListAdminTestJSON-384115257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5cc79712-cc1e-4c15-a77d-3304c359b7eb tempest-VolumesListAdminTestJSON-384115257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:12 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5cc79712-cc1e-4c15-a77d-3304c359b7eb tempest-VolumesListAdminTestJSON-384115257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:11:12 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5cc79712-cc1e-4c15-a77d-3304c359b7eb tempest-VolumesListAdminTestJSON-384115257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:11:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5cc79712-cc1e-4c15-a77d-3304c359b7eb tempest-VolumesListAdminTestJSON-384115257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5cc79712-cc1e-4c15-a77d-3304c359b7eb tempest-VolumesListAdminTestJSON-384115257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:12 devstack sudo[87732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:11:12 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:12 devstack sudo[87730]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ba385ac4-7fc1-4291-aef5-42f7351a28ee tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.info" returned: 0 in 0.456s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:12 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-ba385ac4-7fc1-4291-aef5-42f7351a28ee tempest-GroupSnapshotsTest-2035960321 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.info is being set with open permissions: ugo+rw: NotImplementedError Apr 27 10:11:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ba385ac4-7fc1-4291-aef5-42f7351a28ee tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:12 devstack sudo[87735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.info Apr 27 10:11:12 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:12 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5cc79712-cc1e-4c15-a77d-3304c359b7eb tempest-VolumesListAdminTestJSON-384115257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.432s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:12 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-5cc79712-cc1e-4c15-a77d-3304c359b7eb tempest-VolumesListAdminTestJSON-384115257 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:11:12 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-5cc79712-cc1e-4c15-a77d-3304c359b7eb tempest-VolumesListAdminTestJSON-384115257 None] Deleted volume successfully. Apr 27 10:11:12 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:INSERT=44,cinder:UPDATE=191,cinder:SELECT=155,cinder:DELETE=16 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:11:12 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5cc79712-cc1e-4c15-a77d-3304c359b7eb tempest-VolumesListAdminTestJSON-384115257 None] Lock "cinder-7c436676-de7f-47eb-b2ee-b32b3c450d46-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:11:13 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ba385ac4-7fc1-4291-aef5-42f7351a28ee tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.info" returned: 0 in 0.427s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ba385ac4-7fc1-4291-aef5-42f7351a28ee tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.073s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0a9dfa78-8290-4dce-85d6-3b965da66922 tempest-VolumesActionsTest-1292551954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.897s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:13 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf4ea1a-df01-4ff0-beef-e3d811266d73]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0a9dfa78-8290-4dce-85d6-3b965da66922 tempest-VolumesActionsTest-1292551954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:13 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-ba385ac4-7fc1-4291-aef5-42f7351a28ee tempest-GroupSnapshotsTest-2035960321 None] group_snapshot 7c21b9c0-9f40-4635-8889-b808b95a35fb: created successfully Apr 27 10:11:13 devstack sudo[87739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b Apr 27 10:11:13 devstack sudo[87739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-da37c3cc-7273-46ae-ab53-591b10acfe01 tempest-VolumesListAdminTestJSON-384115257 None] Acquiring lock "cinder-07e052a9-a28b-4ed5-997c-123cb2cef6c3-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:11:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-da37c3cc-7273-46ae-ab53-591b10acfe01 tempest-VolumesListAdminTestJSON-384115257 None] Lock "cinder-07e052a9-a28b-4ed5-997c-123cb2cef6c3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:11:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-da37c3cc-7273-46ae-ab53-591b10acfe01 tempest-VolumesListAdminTestJSON-384115257 None] Acquiring lock "cinder-quobyte-07e052a9-a28b-4ed5-997c-123cb2cef6c3" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:11:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-da37c3cc-7273-46ae-ab53-591b10acfe01 tempest-VolumesListAdminTestJSON-384115257 None] Lock "cinder-quobyte-07e052a9-a28b-4ed5-997c-123cb2cef6c3" acquired by "delete_volume" :: waited 0.023s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:11:13 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ef7b8d-9e99-4037-a8d2-ef9c0b465256]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-da37c3cc-7273-46ae-ab53-591b10acfe01 tempest-VolumesListAdminTestJSON-384115257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-07e052a9-a28b-4ed5-997c-123cb2cef6c3 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:13 devstack sudo[87742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-07e052a9-a28b-4ed5-997c-123cb2cef6c3 Apr 27 10:11:13 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:13 devstack sudo[87739]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0a9dfa78-8290-4dce-85d6-3b965da66922 tempest-VolumesActionsTest-1292551954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b" returned: 0 in 0.576s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:13 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef16dcf-2d95-4040-b6c5-1397e504e9e4]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0a9dfa78-8290-4dce-85d6-3b965da66922 tempest-VolumesActionsTest-1292551954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:13 devstack sudo[87746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b Apr 27 10:11:13 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:14 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-da37c3cc-7273-46ae-ab53-591b10acfe01 tempest-VolumesListAdminTestJSON-384115257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-07e052a9-a28b-4ed5-997c-123cb2cef6c3" returned: 0 in 0.576s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-da37c3cc-7273-46ae-ab53-591b10acfe01 tempest-VolumesListAdminTestJSON-384115257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-07e052a9-a28b-4ed5-997c-123cb2cef6c3 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:14 devstack sudo[87753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-07e052a9-a28b-4ed5-997c-123cb2cef6c3 Apr 27 10:11:14 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:14 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0a9dfa78-8290-4dce-85d6-3b965da66922 tempest-VolumesActionsTest-1292551954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b" returned: 0 in 0.563s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0a9dfa78-8290-4dce-85d6-3b965da66922 tempest-VolumesActionsTest-1292551954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b /opt/stack/data/cinder/conversion/ad382ce3-d94a-434d-9a6c-13957956a23b.temp_image.07a3e487-ac05-4594-9439-da9c6f37847f5i7mcc0z.img {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:14 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b /opt/stack/data/cinder/conversion/ad382ce3-d94a-434d-9a6c-13957956a23b.temp_image.07a3e487-ac05-4594-9439-da9c6f37847f5i7mcc0z.img Apr 27 10:11:14 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:14 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-da37c3cc-7273-46ae-ab53-591b10acfe01 tempest-VolumesListAdminTestJSON-384115257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-07e052a9-a28b-4ed5-997c-123cb2cef6c3" returned: 0 in 0.484s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:14 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-da37c3cc-7273-46ae-ab53-591b10acfe01 tempest-VolumesListAdminTestJSON-384115257 None] Lock "cinder-quobyte-07e052a9-a28b-4ed5-997c-123cb2cef6c3" released by "delete_volume" :: held 1.104s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:11:14 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-da37c3cc-7273-46ae-ab53-591b10acfe01 tempest-VolumesListAdminTestJSON-384115257 None] Created reservations ['452b5d96-5c2e-4432-b3c3-4336e99a6059', 'b26ebb26-f6ec-4fc3-8a1a-4570a328d9e8', 'a9191031-98a3-4605-bfc7-779a7c801f38', '1132bd73-bb2e-4177-b906-ac5e658d96da'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:11:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-da37c3cc-7273-46ae-ab53-591b10acfe01 tempest-VolumesListAdminTestJSON-384115257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-da37c3cc-7273-46ae-ab53-591b10acfe01 tempest-VolumesListAdminTestJSON-384115257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-da37c3cc-7273-46ae-ab53-591b10acfe01 tempest-VolumesListAdminTestJSON-384115257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:11:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-da37c3cc-7273-46ae-ab53-591b10acfe01 tempest-VolumesListAdminTestJSON-384115257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:11:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-da37c3cc-7273-46ae-ab53-591b10acfe01 tempest-VolumesListAdminTestJSON-384115257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-da37c3cc-7273-46ae-ab53-591b10acfe01 tempest-VolumesListAdminTestJSON-384115257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:14 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:11:14 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:15 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:INSERT=51,cinder:UPDATE=214,cinder:SELECT=140,cinder:DELETE=15 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:11:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:16 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-da37c3cc-7273-46ae-ab53-591b10acfe01 tempest-VolumesListAdminTestJSON-384115257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 1.241s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:16 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-da37c3cc-7273-46ae-ab53-591b10acfe01 tempest-VolumesListAdminTestJSON-384115257 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:11:16 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-da37c3cc-7273-46ae-ab53-591b10acfe01 tempest-VolumesListAdminTestJSON-384115257 None] Deleted volume successfully. Apr 27 10:11:16 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-da37c3cc-7273-46ae-ab53-591b10acfe01 tempest-VolumesListAdminTestJSON-384115257 None] Lock "cinder-07e052a9-a28b-4ed5-997c-123cb2cef6c3-delete_volume" released by "delete_volume" :: held 2.615s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:11:16 devstack cinder-volume[81350]: DEBUG oslo_service.periodic_task [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81350) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 10:11:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:11:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:11:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:16 devstack sudo[87779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:11:16 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:17 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 1.036s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:17 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:11:19 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0a9dfa78-8290-4dce-85d6-3b965da66922 tempest-VolumesActionsTest-1292551954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b /opt/stack/data/cinder/conversion/ad382ce3-d94a-434d-9a6c-13957956a23b.temp_image.07a3e487-ac05-4594-9439-da9c6f37847f5i7mcc0z.img" returned: 0 in 5.526s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:19 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8de903-69f0-42cc-b121-8b41fa86e599]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0a9dfa78-8290-4dce-85d6-3b965da66922 tempest-VolumesActionsTest-1292551954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:19 devstack sudo[87782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b Apr 27 10:11:19 devstack sudo[87782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:20 devstack sudo[87782]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0a9dfa78-8290-4dce-85d6-3b965da66922 tempest-VolumesActionsTest-1292551954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b" returned: 0 in 0.727s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:20 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-0a9dfa78-8290-4dce-85d6-3b965da66922 tempest-VolumesActionsTest-1292551954 None] Image conversion details: src /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b, size 1024.00 MB, duration 5.53 sec, destination /opt/stack/data/cinder/conversion/ad382ce3-d94a-434d-9a6c-13957956a23b.temp_image.07a3e487-ac05-4594-9439-da9c6f37847f5i7mcc0z.img {{(pid=81350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 10:11:20 devstack cinder-volume[81350]: INFO cinder.image.image_utils [None req-0a9dfa78-8290-4dce-85d6-3b965da66922 tempest-VolumesActionsTest-1292551954 None] Converted 1024.00 MB image at 185.25 MB/s Apr 27 10:11:20 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-0a9dfa78-8290-4dce-85d6-3b965da66922 tempest-VolumesActionsTest-1292551954 None] 07a3e487-ac05-4594-9439-da9c6f37847f was raw, no need to convert to raw {{(pid=81350) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 27 10:11:21 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:11:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Flow 'volume_create_manager' (987129ce-4773-4a78-acbe-ea88646e83b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:11:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572e2dfd-e71b-4303-8f5f-d9c2a26e3b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572e2dfd-e71b-4303-8f5f-d9c2a26e3b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-591368167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2397c9b-beb6-4760-aff3-87ec189a96e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7169f7d452d74edc94dfc3fab9cbb89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:11:22Z,use_quota=True,user_id='9fef1f391ea14aa5a0e5c6b8e9d35e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db50b42-ee2e-40f2-afb8-bccaad27fc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db50b42-ee2e-40f2-afb8-bccaad27fc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7199763b-de71-46ef-aec6-aa47d27bd4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:21 devstack cinder-volume[81350]: DEBUG cinder.image.glance [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Creating Keystone auth plugin from conf {{(pid=81350) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 27 10:11:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7199763b-de71-46ef-aec6-aa47d27bd4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd2397c9b-beb6-4760-aff3-87ec189a96e4', 'volume_name': 'volume-d2397c9b-beb6-4760-aff3-87ec189a96e4', 'volume_size': 1, 'image_id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f81a6757fcfa47c099a3bbded3b529cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'created_at': datetime.datetime(2026, 4, 27, 7, 59, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 7, 59, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee5787c-7788-48a5-b3ef-dce90b91f1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee5787c-7788-48a5-b3ef-dce90b91f1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb976a75-9a0c-4f4b-b001-59377aeca91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:21 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Volume d2397c9b-beb6-4760-aff3-87ec189a96e4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d2397c9b-beb6-4760-aff3-87ec189a96e4', 'volume_size': 1, 'image_id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f81a6757fcfa47c099a3bbded3b529cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'created_at': datetime.datetime(2026, 4, 27, 7, 59, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 7, 59, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 27 10:11:21 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Trying to clone d2397c9b-beb6-4760-aff3-87ec189a96e4 from image d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa at location (None, [{'url': 'file:///opt/stack/data/glance/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'metadata': {}}]). {{(pid=81350) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 27 10:11:22 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_6ab3gevbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81350) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 27 10:11:22 devstack cinder-volume[81350]: INFO cinder.image.image_utils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Image download 20.69 MB at 20.69 MB/s Apr 27 10:11:22 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e950bbb6-f61e-4630-bb60-6eb6f1fcf87c]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_6ab3gevbdevstack@QuobyteHD {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:22 devstack sudo[87788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_6ab3gevbdevstack@QuobyteHD Apr 27 10:11:22 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:22 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_6ab3gevbdevstack@QuobyteHD" returned: 0 in 0.591s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:22 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Temporary image d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa is fetched for user 9fef1f391ea14aa5a0e5c6b8e9d35e18. {{(pid=81350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 27 10:11:23 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e086f7c6-2280-470c-b614-9e241188f997]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_6ab3gevbdevstack@QuobyteHD {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:23 devstack sudo[87793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_6ab3gevbdevstack@QuobyteHD Apr 27 10:11:23 devstack sudo[87793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:23 devstack sudo[87793]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_6ab3gevbdevstack@QuobyteHD" returned: 0 in 0.508s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:31 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:UPDATE=8,cinder:SELECT=15,cinder:INSERT=2 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:11:32 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:DELETE=1,cinder:SELECT=3,cinder:INSERT=1 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:11:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0a9dfa78-8290-4dce-85d6-3b965da66922 tempest-VolumesActionsTest-1292551954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 22.857s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a9dfa78-8290-4dce-85d6-3b965da66922 tempest-VolumesActionsTest-1292551954 None] Uploaded volume to glance image-id: 07a3e487-ac05-4594-9439-da9c6f37847f. {{(pid=81350) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 27 10:11:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 20.342s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "cinder-quobyte-dacedd3c-6ca8-47d6-a417-9881cc01aaa9-f1e59c10-7440-4f06-882e-5ef6de1250e3" by "_create_volume_from_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:11:36 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-0a9dfa78-8290-4dce-85d6-3b965da66922 tempest-VolumesActionsTest-1292551954 None] Copy volume to image completed successfully. Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-dacedd3c-6ca8-47d6-a417-9881cc01aaa9-f1e59c10-7440-4f06-882e-5ef6de1250e3" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Creating volume f1e59c10-7440-4f06-882e-5ef6de1250e3 from snapshot dacedd3c-6ca8-47d6-a417-9881cc01aaa9 {{(pid=81350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "cinder-quobyte-f1e59c10-7440-4f06-882e-5ef6de1250e3" by "_copy_volume_from_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-f1e59c10-7440-4f06-882e-5ef6de1250e3" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] snapshot: dacedd3c-6ca8-47d6-a417-9881cc01aaa9, volume: f1e59c10-7440-4f06-882e-5ef6de1250e3, {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06a13cc-be30-41b0-96eb-d06d7edf3266]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.dacedd3c-6ca8-47d6-a417-9881cc01aaa9 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:36 devstack sudo[87802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.dacedd3c-6ca8-47d6-a417-9881cc01aaa9 Apr 27 10:11:36 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:36 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.dacedd3c-6ca8-47d6-a417-9881cc01aaa9" returned: 0 in 0.548s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Creating direct copy from snapshot {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c1347b-40f6-4947-a82c-be87299adf42]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:36 devstack sudo[87809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 Apr 27 10:11:36 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:37 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52" returned: 0 in 0.513s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:37 devstack cinder-volume[81350]: DEBUG cinder.utils [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Path /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f1e59c10-7440-4f06-882e-5ef6de1250e3 not found in is_blk_device check {{(pid=81350) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 27 10:11:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f1e59c10-7440-4f06-882e-5ef6de1250e3 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:37 devstack sudo[87814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f1e59c10-7440-4f06-882e-5ef6de1250e3 Apr 27 10:11:37 devstack sudo[87814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:41 devstack sudo[87814]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f1e59c10-7440-4f06-882e-5ef6de1250e3" returned: 0 in 4.544s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:41 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[930349c6-996e-4151-a10a-a8fd2472b4c1]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:41 devstack sudo[87826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 Apr 27 10:11:41 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:42 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52" returned: 0 in 0.637s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:42 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Image conversion details: src /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52, size 1024.00 MB, duration 4.55 sec, destination /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f1e59c10-7440-4f06-882e-5ef6de1250e3 {{(pid=81350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 10:11:42 devstack cinder-volume[81350]: INFO cinder.image.image_utils [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Converted 1024.00 MB image at 225.28 MB/s Apr 27 10:11:42 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f1e59c10-7440-4f06-882e-5ef6de1250e3 is being set with open permissions: ugo+rw: NotImplementedError Apr 27 10:11:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f1e59c10-7440-4f06-882e-5ef6de1250e3 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:42 devstack sudo[87831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f1e59c10-7440-4f06-882e-5ef6de1250e3 Apr 27 10:11:42 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:42 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f1e59c10-7440-4f06-882e-5ef6de1250e3" returned: 0 in 0.441s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:42 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-f1e59c10-7440-4f06-882e-5ef6de1250e3" released by "_copy_volume_from_snapshot" :: held 6.780s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:11:42 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-dacedd3c-6ca8-47d6-a417-9881cc01aaa9-f1e59c10-7440-4f06-882e-5ef6de1250e3" released by "_create_volume_from_snapshot" :: held 6.813s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:11:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.842s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.316s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:42 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-591368167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2397c9b-beb6-4760-aff3-87ec189a96e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7169f7d452d74edc94dfc3fab9cbb89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:11:22Z,use_quota=True,user_id='9fef1f391ea14aa5a0e5c6b8e9d35e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:11:42 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Creating volume d2397c9b-beb6-4760-aff3-87ec189a96e4 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:11:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:42 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:11:42 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:11:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:42 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:11:42 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:11:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:42 devstack sudo[87834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4 1073741824 Apr 27 10:11:42 devstack sudo[87834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:42 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-21fb2371-f1f3-4935-9d45-b9a057323821 tempest-GroupSnapshotsTest-2035960321 None] Create group from source-snapshot-7c21b9c0-9f40-4635-8889-b808b95a35fb completed successfully. Apr 27 10:11:43 devstack sudo[87834]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4 1073741824" returned: 0 in 0.592s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:43 devstack sudo[87840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4 Apr 27 10:11:43 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-79e5224f-ac96-4e66-96f6-32b406e58a6d tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "cinder-quobyte-f1e59c10-7440-4f06-882e-5ef6de1250e3" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:11:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-79e5224f-ac96-4e66-96f6-32b406e58a6d tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-f1e59c10-7440-4f06-882e-5ef6de1250e3" acquired by "delete_volume" :: waited 0.022s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:11:43 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48c936c-eb2d-4197-ba92-3da6164d27ea]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-79e5224f-ac96-4e66-96f6-32b406e58a6d tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f1e59c10-7440-4f06-882e-5ef6de1250e3 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:43 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4" returned: 0 in 0.487s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:43 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:11:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 7.075s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:43 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cc050f-4a25-4d74-81c6-bc42efe8fabe]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:43 devstack sudo[87843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f1e59c10-7440-4f06-882e-5ef6de1250e3 Apr 27 10:11:43 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:43 devstack cinder-volume[81350]: DEBUG cinder.volume.volume_utils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Attempting download of d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa ((None, [{'url': 'file:///opt/stack/data/glance/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'metadata': {}}])) to volume d2397c9b-beb6-4760-aff3-87ec189a96e4. {{(pid=81350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 27 10:11:44 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e98307a-b176-495a-b70f-fefe4d6f6f3f]: (4, 'raw') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_70hv81l_ {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:44 devstack sudo[87844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b Apr 27 10:11:44 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:44 devstack sudo[87846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_70hv81l_ Apr 27 10:11:44 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:44 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-79e5224f-ac96-4e66-96f6-32b406e58a6d tempest-GroupSnapshotsTest-2035960321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f1e59c10-7440-4f06-882e-5ef6de1250e3" returned: 0 in 0.564s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-79e5224f-ac96-4e66-96f6-32b406e58a6d tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f1e59c10-7440-4f06-882e-5ef6de1250e3 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:44 devstack sudo[87857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f1e59c10-7440-4f06-882e-5ef6de1250e3 Apr 27 10:11:44 devstack sudo[87857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:44 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b" returned: 0 in 0.555s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:44 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3394aa-0bda-4839-8647-c64020799c46]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:44 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_70hv81l_" returned: 0 in 0.499s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_70hv81l_ {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:44 devstack sudo[87859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b Apr 27 10:11:44 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:44 devstack sudo[87861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_70hv81l_ Apr 27 10:11:44 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:44 devstack sudo[87857]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-79e5224f-ac96-4e66-96f6-32b406e58a6d tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f1e59c10-7440-4f06-882e-5ef6de1250e3" returned: 0 in 0.441s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:44 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-79e5224f-ac96-4e66-96f6-32b406e58a6d tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-f1e59c10-7440-4f06-882e-5ef6de1250e3" released by "delete_volume" :: held 1.048s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:11:44 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-79e5224f-ac96-4e66-96f6-32b406e58a6d tempest-GroupSnapshotsTest-2035960321 None] Created reservations ['1200276f-a0c6-42f8-9869-341d4e36e78f'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:11:45 devstack cinder-volume[81350]: WARNING cinder.quota [None req-79e5224f-ac96-4e66-96f6-32b406e58a6d tempest-GroupSnapshotsTest-2035960321 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-639993049 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-639993049, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:11:45 devstack cinder-volume[81350]: WARNING cinder.quota [None req-79e5224f-ac96-4e66-96f6-32b406e58a6d tempest-GroupSnapshotsTest-2035960321 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-639993049 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-639993049, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:11:45 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-79e5224f-ac96-4e66-96f6-32b406e58a6d tempest-GroupSnapshotsTest-2035960321 None] Created reservations ['6eb2e9b0-879e-49bc-988f-1d95437a46c7', '2e4ef1ef-3af8-4771-a268-c9a58ed9885f', 'a57d510e-a7c6-4af1-8fc9-a32870311d58', 'b9a931c4-4176-4bbd-872a-85ee43accb7a'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:11:45 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_70hv81l_" returned: 1 in 0.545s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_70hv81l_' failed. Not Retrying. {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 10:11:45 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71b0f72-df3d-4e2a-8d30-74be6602a6a2]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_6ab3gevbdevstack@QuobyteHD {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:45 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b" returned: 0 in 0.600s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b /opt/stack/data/cinder/conversion/ad382ce3-d94a-434d-9a6c-13957956a23b.temp_image.67a35251-10f2-4110-bddc-4009a9880f0bjww4pj8j.img {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:45 devstack sudo[87871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b /opt/stack/data/cinder/conversion/ad382ce3-d94a-434d-9a6c-13957956a23b.temp_image.67a35251-10f2-4110-bddc-4009a9880f0bjww4pj8j.img Apr 27 10:11:45 devstack sudo[87871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:45 devstack sudo[87870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_6ab3gevbdevstack@QuobyteHD Apr 27 10:11:45 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-79e5224f-ac96-4e66-96f6-32b406e58a6d tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-79e5224f-ac96-4e66-96f6-32b406e58a6d tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:45 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-79e5224f-ac96-4e66-96f6-32b406e58a6d tempest-GroupSnapshotsTest-2035960321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:11:45 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-79e5224f-ac96-4e66-96f6-32b406e58a6d tempest-GroupSnapshotsTest-2035960321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:11:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-79e5224f-ac96-4e66-96f6-32b406e58a6d tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-79e5224f-ac96-4e66-96f6-32b406e58a6d tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:45 devstack sudo[87874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:11:45 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:45 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-79e5224f-ac96-4e66-96f6-32b406e58a6d tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.447s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:45 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-79e5224f-ac96-4e66-96f6-32b406e58a6d tempest-GroupSnapshotsTest-2035960321 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:11:45 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-79e5224f-ac96-4e66-96f6-32b406e58a6d tempest-GroupSnapshotsTest-2035960321 None] Delete group completed successfully. Apr 27 10:11:45 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_6ab3gevbdevstack@QuobyteHD" returned: 0 in 0.721s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:45 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa was qcow2, converting to raw {{(pid=81350) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 27 10:11:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_6ab3gevbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:45 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_6ab3gevbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4 Apr 27 10:11:45 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:46 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-baea1784-47ac-4ba4-9feb-ab07d1f44c3c tempest-GroupSnapshotsTest-2035960321 None] group_snapshot 7c21b9c0-9f40-4635-8889-b808b95a35fb: deleting Apr 27 10:11:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-baea1784-47ac-4ba4-9feb-ab07d1f44c3c tempest-GroupSnapshotsTest-2035960321 None] group_snapshot 7c21b9c0-9f40-4635-8889-b808b95a35fb: deleting {{(pid=81350) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 27 10:11:46 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-baea1784-47ac-4ba4-9feb-ab07d1f44c3c tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "cinder-quobyte-56e9f1a9-a9e8-400e-b5de-f795f98d1f52" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:11:46 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-baea1784-47ac-4ba4-9feb-ab07d1f44c3c tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-56e9f1a9-a9e8-400e-b5de-f795f98d1f52" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:11:46 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-baea1784-47ac-4ba4-9feb-ab07d1f44c3c tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "cinder-quobyte-dacedd3c-6ca8-47d6-a417-9881cc01aaa9" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:11:46 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-baea1784-47ac-4ba4-9feb-ab07d1f44c3c tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-dacedd3c-6ca8-47d6-a417-9881cc01aaa9" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:11:46 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-baea1784-47ac-4ba4-9feb-ab07d1f44c3c tempest-GroupSnapshotsTest-2035960321 None] Deleting offline snapshot dacedd3c-6ca8-47d6-a417-9881cc01aaa9 of volume 56e9f1a9-a9e8-400e-b5de-f795f98d1f52 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:11:46 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-baea1784-47ac-4ba4-9feb-ab07d1f44c3c tempest-GroupSnapshotsTest-2035960321 None] snapshot_file for this snap is: volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.dacedd3c-6ca8-47d6-a417-9881cc01aaa9 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:11:46 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddc3b33-a627-4f9b-8fac-caf3821b2b67]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-baea1784-47ac-4ba4-9feb-ab07d1f44c3c tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.dacedd3c-6ca8-47d6-a417-9881cc01aaa9 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:46 devstack sudo[87895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.dacedd3c-6ca8-47d6-a417-9881cc01aaa9 Apr 27 10:11:46 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:47 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-baea1784-47ac-4ba4-9feb-ab07d1f44c3c tempest-GroupSnapshotsTest-2035960321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.dacedd3c-6ca8-47d6-a417-9881cc01aaa9" returned: 0 in 1.194s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:47 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-baea1784-47ac-4ba4-9feb-ab07d1f44c3c tempest-GroupSnapshotsTest-2035960321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:11:47 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[81db9c8e-c829-42f1-98b3-0c4df86493b1]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-baea1784-47ac-4ba4-9feb-ab07d1f44c3c tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:47 devstack sudo[87907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 Apr 27 10:11:47 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:48 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_6ab3gevbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4" returned: 0 in 3.079s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:48 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_6ab3gevbdevstack@QuobyteHD, size 112.00 MB, duration 3.08 sec, destination /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4 {{(pid=81350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 10:11:48 devstack cinder-volume[81350]: INFO cinder.image.image_utils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Converted 112.00 MB image at 36.33 MB/s Apr 27 10:11:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:49 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4 1G Apr 27 10:11:49 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:49 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-baea1784-47ac-4ba4-9feb-ab07d1f44c3c tempest-GroupSnapshotsTest-2035960321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52" returned: 0 in 1.316s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-baea1784-47ac-4ba4-9feb-ab07d1f44c3c tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.dacedd3c-6ca8-47d6-a417-9881cc01aaa9 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:49 devstack sudo[87914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.dacedd3c-6ca8-47d6-a417-9881cc01aaa9 Apr 27 10:11:49 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:50 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4 1G" returned: 0 in 1.137s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:50 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2005d3b-6390-4420-9cf5-381ff8a70cbd]: (4, 'raw') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:50 devstack sudo[87919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4 Apr 27 10:11:50 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:50 devstack sudo[87871]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b /opt/stack/data/cinder/conversion/ad382ce3-d94a-434d-9a6c-13957956a23b.temp_image.67a35251-10f2-4110-bddc-4009a9880f0bjww4pj8j.img" returned: 0 in 5.080s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:50 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c268f5-ddab-4af6-a1b9-e0d544936ab9]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:50 devstack sudo[87924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b Apr 27 10:11:50 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:50 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-baea1784-47ac-4ba4-9feb-ab07d1f44c3c tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.dacedd3c-6ca8-47d6-a417-9881cc01aaa9" returned: 0 in 1.228s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-baea1784-47ac-4ba4-9feb-ab07d1f44c3c tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.dacedd3c-6ca8-47d6-a417-9881cc01aaa9 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:50 devstack sudo[87926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.dacedd3c-6ca8-47d6-a417-9881cc01aaa9 Apr 27 10:11:50 devstack sudo[87926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:50 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4" returned: 0 in 0.517s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:50 devstack sudo[87930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4 Apr 27 10:11:50 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:50 devstack sudo[87926]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-baea1784-47ac-4ba4-9feb-ab07d1f44c3c tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52.dacedd3c-6ca8-47d6-a417-9881cc01aaa9" returned: 0 in 0.426s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:50 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-baea1784-47ac-4ba4-9feb-ab07d1f44c3c tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-dacedd3c-6ca8-47d6-a417-9881cc01aaa9" released by "_delete_snapshot" :: held 4.346s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:11:50 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-baea1784-47ac-4ba4-9feb-ab07d1f44c3c tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-56e9f1a9-a9e8-400e-b5de-f795f98d1f52" released by "delete_snapshot" :: held 4.399s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:11:50 devstack cinder-volume[81350]: WARNING cinder.quota [None req-baea1784-47ac-4ba4-9feb-ab07d1f44c3c tempest-GroupSnapshotsTest-2035960321 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-639993049 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-639993049, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:11:50 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-baea1784-47ac-4ba4-9feb-ab07d1f44c3c tempest-GroupSnapshotsTest-2035960321 None] Created reservations ['58fbe070-d58e-4ac0-b0e8-ff8a07562930', 'bc4dfc32-0115-4b46-9a03-2d01340a5a37', '003e1261-5e02-4444-9bf1-eead17afb316', '7fb8397f-1f14-4214-8908-22da8f83d0e8'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:11:50 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b" returned: 0 in 0.695s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:50 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] Image conversion details: src /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b, size 1024.00 MB, duration 5.08 sec, destination /opt/stack/data/cinder/conversion/ad382ce3-d94a-434d-9a6c-13957956a23b.temp_image.67a35251-10f2-4110-bddc-4009a9880f0bjww4pj8j.img {{(pid=81350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 10:11:50 devstack cinder-volume[81350]: INFO cinder.image.image_utils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] Converted 1024.00 MB image at 201.49 MB/s Apr 27 10:11:50 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] 67a35251-10f2-4110-bddc-4009a9880f0b was raw, converting to qcow2 {{(pid=81350) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 27 10:11:50 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-baea1784-47ac-4ba4-9feb-ab07d1f44c3c tempest-GroupSnapshotsTest-2035960321 None] group_snapshot 7c21b9c0-9f40-4635-8889-b808b95a35fb: deleted successfully Apr 27 10:11:50 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[be62bb77-029d-4f07-a873-d0e9dbcea33f]: (4, 'raw') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ad382ce3-d94a-434d-9a6c-13957956a23b.temp_image.67a35251-10f2-4110-bddc-4009a9880f0bjww4pj8j.img {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:51 devstack sudo[87936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ad382ce3-d94a-434d-9a6c-13957956a23b.temp_image.67a35251-10f2-4110-bddc-4009a9880f0bjww4pj8j.img Apr 27 10:11:51 devstack sudo[87936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:51 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4" returned: 1 in 0.537s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4' failed. Not Retrying. {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 10:11:51 devstack cinder-volume[81350]: DEBUG cinder.volume.volume_utils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Downloaded image d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa ((None, [{'url': 'file:///opt/stack/data/glance/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'metadata': {}}])) to volume d2397c9b-beb6-4760-aff3-87ec189a96e4 successfully. {{(pid=81350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 27 10:11:51 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Temporary image d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa for user 9fef1f391ea14aa5a0e5c6b8e9d35e18 is deleted. {{(pid=81350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 27 10:11:51 devstack cinder-volume[81350]: DEBUG cinder.volume.volume_utils [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Marking volume d2397c9b-beb6-4760-aff3-87ec189a96e4 as bootable. {{(pid=81350) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 27 10:11:51 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Copying metadata from image d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa to d2397c9b-beb6-4760-aff3-87ec189a96e4. {{(pid=81350) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 27 10:11:51 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Creating volume glance metadata for volume d2397c9b-beb6-4760-aff3-87ec189a96e4 backed by image d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81350) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 27 10:11:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb976a75-9a0c-4f4b-b001-59377aeca91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2397c9b-beb6-4760-aff3-87ec189a96e4', 'volume_size': 1, 'image_id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f81a6757fcfa47c099a3bbded3b529cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'created_at': datetime.datetime(2026, 4, 27, 7, 59, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 7, 59, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7712d594-466a-4d63-afad-7982340a7198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:51 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Volume volume-d2397c9b-beb6-4760-aff3-87ec189a96e4 (d2397c9b-beb6-4760-aff3-87ec189a96e4): created successfully Apr 27 10:11:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7712d594-466a-4d63-afad-7982340a7198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Flow 'volume_create_manager' (987129ce-4773-4a78-acbe-ea88646e83b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:11:51 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-759699aa-b310-45c7-bbf2-94e0c65a673d tempest-VolumesImageMetadata-1870719395 None] Created volume successfully. Apr 27 10:11:51 devstack sudo[87936]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ad382ce3-d94a-434d-9a6c-13957956a23b.temp_image.67a35251-10f2-4110-bddc-4009a9880f0bjww4pj8j.img" returned: 0 in 0.524s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ad382ce3-d94a-434d-9a6c-13957956a23b.temp_image.67a35251-10f2-4110-bddc-4009a9880f0bjww4pj8j.img {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:51 devstack sudo[87943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ad382ce3-d94a-434d-9a6c-13957956a23b.temp_image.67a35251-10f2-4110-bddc-4009a9880f0bjww4pj8j.img Apr 27 10:11:51 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:51 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ad382ce3-d94a-434d-9a6c-13957956a23b.temp_image.67a35251-10f2-4110-bddc-4009a9880f0bjww4pj8j.img" returned: 1 in 0.488s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ad382ce3-d94a-434d-9a6c-13957956a23b.temp_image.67a35251-10f2-4110-bddc-4009a9880f0bjww4pj8j.img' failed. Not Retrying. {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 10:11:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ad382ce3-d94a-434d-9a6c-13957956a23b.temp_image.67a35251-10f2-4110-bddc-4009a9880f0bjww4pj8j.img /opt/stack/data/cinder/conversion/vol_upload_7ujew03t {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:52 devstack sudo[87948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ad382ce3-d94a-434d-9a6c-13957956a23b.temp_image.67a35251-10f2-4110-bddc-4009a9880f0bjww4pj8j.img /opt/stack/data/cinder/conversion/vol_upload_7ujew03t Apr 27 10:11:52 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:52 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-011a77a6-8784-4dc1-8fb0-0cd457eae602 tempest-VolumesImageMetadata-1870719395 None] Acquiring lock "cinder-d2397c9b-beb6-4760-aff3-87ec189a96e4-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:11:52 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-011a77a6-8784-4dc1-8fb0-0cd457eae602 tempest-VolumesImageMetadata-1870719395 None] Lock "cinder-d2397c9b-beb6-4760-aff3-87ec189a96e4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:11:52 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-011a77a6-8784-4dc1-8fb0-0cd457eae602 tempest-VolumesImageMetadata-1870719395 None] Acquiring lock "cinder-quobyte-d2397c9b-beb6-4760-aff3-87ec189a96e4" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:11:52 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1ce7e28f-0792-4d53-a803-f377808874c4 tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "cinder-quobyte-56e9f1a9-a9e8-400e-b5de-f795f98d1f52" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:11:52 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-011a77a6-8784-4dc1-8fb0-0cd457eae602 tempest-VolumesImageMetadata-1870719395 None] Lock "cinder-quobyte-d2397c9b-beb6-4760-aff3-87ec189a96e4" acquired by "delete_volume" :: waited 0.020s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:11:52 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1ce7e28f-0792-4d53-a803-f377808874c4 tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-56e9f1a9-a9e8-400e-b5de-f795f98d1f52" acquired by "delete_volume" :: waited 0.034s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:11:52 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6672ea76-ff35-4c2f-bf45-d4999163ed26]: (4, 'raw') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-011a77a6-8784-4dc1-8fb0-0cd457eae602 tempest-VolumesImageMetadata-1870719395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:52 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19d6006-7652-4fdb-983d-236fd3c69e64]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1ce7e28f-0792-4d53-a803-f377808874c4 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:52 devstack sudo[87950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4 Apr 27 10:11:52 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:52 devstack sudo[87951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 Apr 27 10:11:52 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:52 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ad382ce3-d94a-434d-9a6c-13957956a23b.temp_image.67a35251-10f2-4110-bddc-4009a9880f0bjww4pj8j.img /opt/stack/data/cinder/conversion/vol_upload_7ujew03t" returned: 0 in 0.506s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:52 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] Image conversion details: src /opt/stack/data/cinder/conversion/ad382ce3-d94a-434d-9a6c-13957956a23b.temp_image.67a35251-10f2-4110-bddc-4009a9880f0bjww4pj8j.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_7ujew03t {{(pid=81350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 10:11:52 devstack cinder-volume[81350]: INFO cinder.image.image_utils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 27 10:11:52 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd15fc3-b5d9-4d7b-872f-873f9a8c8b16]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7ujew03t {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:52 devstack sudo[87957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7ujew03t Apr 27 10:11:52 devstack sudo[87957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:52 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1ce7e28f-0792-4d53-a803-f377808874c4 tempest-GroupSnapshotsTest-2035960321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52" returned: 0 in 0.520s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1ce7e28f-0792-4d53-a803-f377808874c4 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:52 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-011a77a6-8784-4dc1-8fb0-0cd457eae602 tempest-VolumesImageMetadata-1870719395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4" returned: 0 in 0.557s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-011a77a6-8784-4dc1-8fb0-0cd457eae602 tempest-VolumesImageMetadata-1870719395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:52 devstack sudo[87964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52 Apr 27 10:11:52 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:52 devstack sudo[87965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4 Apr 27 10:11:52 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:53 devstack sudo[87957]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7ujew03t" returned: 0 in 0.530s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:53 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1ce7e28f-0792-4d53-a803-f377808874c4 tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-56e9f1a9-a9e8-400e-b5de-f795f98d1f52" returned: 0 in 0.521s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:53 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1ce7e28f-0792-4d53-a803-f377808874c4 tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-56e9f1a9-a9e8-400e-b5de-f795f98d1f52" released by "delete_volume" :: held 1.104s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:11:53 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-1ce7e28f-0792-4d53-a803-f377808874c4 tempest-GroupSnapshotsTest-2035960321 None] Created reservations ['c311452f-b2c7-4757-b8a2-12125f9bf79d'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:11:53 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-011a77a6-8784-4dc1-8fb0-0cd457eae602 tempest-VolumesImageMetadata-1870719395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4" returned: 1 in 0.665s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-011a77a6-8784-4dc1-8fb0-0cd457eae602 tempest-VolumesImageMetadata-1870719395 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4' failed. Not Retrying. {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 10:11:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-011a77a6-8784-4dc1-8fb0-0cd457eae602 tempest-VolumesImageMetadata-1870719395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:53 devstack cinder-volume[81350]: WARNING cinder.db.sqlalchemy.api [None req-1ce7e28f-0792-4d53-a803-f377808874c4 tempest-GroupSnapshotsTest-2035960321 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-639993049'] Apr 27 10:11:53 devstack sudo[87975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4 Apr 27 10:11:53 devstack sudo[87975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:53 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-1ce7e28f-0792-4d53-a803-f377808874c4 tempest-GroupSnapshotsTest-2035960321 None] Created reservations ['20cc3bc7-10cf-43d7-8249-90c7f3129991', '13d1b104-3fc2-4b3d-b194-7451d89b69bd', '083e8385-0de0-4916-a542-7250d57f9a47', 'a5450c1a-3b83-44d8-b551-5dbba7c661a2'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:11:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1ce7e28f-0792-4d53-a803-f377808874c4 tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1ce7e28f-0792-4d53-a803-f377808874c4 tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-1ce7e28f-0792-4d53-a803-f377808874c4 tempest-GroupSnapshotsTest-2035960321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:11:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-1ce7e28f-0792-4d53-a803-f377808874c4 tempest-GroupSnapshotsTest-2035960321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:11:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1ce7e28f-0792-4d53-a803-f377808874c4 tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1ce7e28f-0792-4d53-a803-f377808874c4 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:53 devstack sudo[87977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:11:53 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:53 devstack sudo[87975]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-011a77a6-8784-4dc1-8fb0-0cd457eae602 tempest-VolumesImageMetadata-1870719395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2397c9b-beb6-4760-aff3-87ec189a96e4" returned: 0 in 0.508s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:54 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-011a77a6-8784-4dc1-8fb0-0cd457eae602 tempest-VolumesImageMetadata-1870719395 None] Lock "cinder-quobyte-d2397c9b-beb6-4760-aff3-87ec189a96e4" released by "delete_volume" :: held 1.803s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:11:54 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-011a77a6-8784-4dc1-8fb0-0cd457eae602 tempest-VolumesImageMetadata-1870719395 None] Created reservations ['b4da36f1-8c75-4cf3-8fb5-72deaea5ed64', 'dee2f84c-81a7-46fd-9a4b-cc2225ffffbe', '5dee6363-0377-439e-8e99-6b33a900e095', '5f61b3cf-581c-41fe-b663-d7112f43f61c'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:11:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-011a77a6-8784-4dc1-8fb0-0cd457eae602 tempest-VolumesImageMetadata-1870719395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-011a77a6-8784-4dc1-8fb0-0cd457eae602 tempest-VolumesImageMetadata-1870719395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-011a77a6-8784-4dc1-8fb0-0cd457eae602 tempest-VolumesImageMetadata-1870719395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:11:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-011a77a6-8784-4dc1-8fb0-0cd457eae602 tempest-VolumesImageMetadata-1870719395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:11:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-011a77a6-8784-4dc1-8fb0-0cd457eae602 tempest-VolumesImageMetadata-1870719395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-011a77a6-8784-4dc1-8fb0-0cd457eae602 tempest-VolumesImageMetadata-1870719395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:54 devstack sudo[87981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:11:54 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:54 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1ce7e28f-0792-4d53-a803-f377808874c4 tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.534s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:54 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-1ce7e28f-0792-4d53-a803-f377808874c4 tempest-GroupSnapshotsTest-2035960321 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:11:54 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-1ce7e28f-0792-4d53-a803-f377808874c4 tempest-GroupSnapshotsTest-2035960321 None] Delete group completed successfully. Apr 27 10:11:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.352s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] Uploaded volume to glance image-id: 67a35251-10f2-4110-bddc-4009a9880f0b. {{(pid=81350) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 27 10:11:54 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-9eb1c1f2-a20b-43ab-bf44-a0d951c4d0c3 tempest-VolumesActionsTest-1292551954 None] Copy volume to image completed successfully. Apr 27 10:11:54 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-011a77a6-8784-4dc1-8fb0-0cd457eae602 tempest-VolumesImageMetadata-1870719395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.511s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:54 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-011a77a6-8784-4dc1-8fb0-0cd457eae602 tempest-VolumesImageMetadata-1870719395 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:11:54 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-011a77a6-8784-4dc1-8fb0-0cd457eae602 tempest-VolumesImageMetadata-1870719395 None] Deleted volume successfully. Apr 27 10:11:54 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-011a77a6-8784-4dc1-8fb0-0cd457eae602 tempest-VolumesImageMetadata-1870719395 None] Lock "cinder-d2397c9b-beb6-4760-aff3-87ec189a96e4-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:11:54 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-081094c2-b45e-44b4-b801-f32644f3a3cf tempest-GroupSnapshotsTest-2035960321 None] Group tempest-GroupSnapshotsTest-Group-2074517816: creating Apr 27 10:11:54 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-081094c2-b45e-44b4-b801-f32644f3a3cf tempest-GroupSnapshotsTest-2035960321 None] Group tempest-GroupSnapshotsTest-Group-2074517816: created successfully Apr 27 10:11:54 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-081094c2-b45e-44b4-b801-f32644f3a3cf tempest-GroupSnapshotsTest-2035960321 None] Create group completed successfully. Apr 27 10:11:55 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c076fd36-659e-47b6-8b42-0d7c608aa3ba tempest-VolumesActionsTest-1292551954 None] Acquiring lock "cinder-ad382ce3-d94a-434d-9a6c-13957956a23b-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:11:55 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c076fd36-659e-47b6-8b42-0d7c608aa3ba tempest-VolumesActionsTest-1292551954 None] Lock "cinder-ad382ce3-d94a-434d-9a6c-13957956a23b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:11:55 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c076fd36-659e-47b6-8b42-0d7c608aa3ba tempest-VolumesActionsTest-1292551954 None] Acquiring lock "cinder-quobyte-ad382ce3-d94a-434d-9a6c-13957956a23b" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:11:55 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c076fd36-659e-47b6-8b42-0d7c608aa3ba tempest-VolumesActionsTest-1292551954 None] Lock "cinder-quobyte-ad382ce3-d94a-434d-9a6c-13957956a23b" acquired by "delete_volume" :: waited 0.042s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:11:55 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ea5a4d-89ea-463c-9c8a-9453f5493b68]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:11:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c076fd36-659e-47b6-8b42-0d7c608aa3ba tempest-VolumesActionsTest-1292551954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:55 devstack sudo[87986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b Apr 27 10:11:55 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:55 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c076fd36-659e-47b6-8b42-0d7c608aa3ba tempest-VolumesActionsTest-1292551954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b" returned: 0 in 0.589s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c076fd36-659e-47b6-8b42-0d7c608aa3ba tempest-VolumesActionsTest-1292551954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:55 devstack sudo[88023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b Apr 27 10:11:55 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Flow 'volume_create_manager' (adccbaef-820e-4a11-9270-4d0620416f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d087ec48-3419-4c0d-b474-c9d52eb16def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d087ec48-3419-4c0d-b474-c9d52eb16def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-865361551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57accf21-1c5b-48ae-9236-1c67f1819141,host='devstack@QuobyteHD#QuobyteHD',id=f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339a6b64c6b94ca98cef7fcca0a2f4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:11:56Z,use_quota=True,user_id='29c0afff810a4c0387dee9391a78ef21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0afee686-718b-4c26-af06-11a038ad5fd1),volume_type_id=0afee686-718b-4c26-af06-11a038ad5fd1)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a4703d0-55df-4c2a-925d-87980aae81dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a4703d0-55df-4c2a-925d-87980aae81dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7667e7-3d9a-42d6-8ad9-18dafd4517eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7667e7-3d9a-42d6-8ad9-18dafd4517eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea', 'volume_name': 'volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c1169d-b734-455b-a353-b6b7ddea4c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c1169d-b734-455b-a353-b6b7ddea4c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17084b59-c026-4435-8038-c0ae902e7598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:56 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Volume f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea', 'volume_size': 1} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=57accf21-1c5b-48ae-9236-1c67f1819141,created_at=2026-04-27T08:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-865361551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57accf21-1c5b-48ae-9236-1c67f1819141,host='devstack@QuobyteHD#QuobyteHD',id=f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339a6b64c6b94ca98cef7fcca0a2f4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:11:56Z,use_quota=True,user_id='29c0afff810a4c0387dee9391a78ef21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0afee686-718b-4c26-af06-11a038ad5fd1),volume_type_id=0afee686-718b-4c26-af06-11a038ad5fd1)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Creating volume f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:11:56 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:56 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c076fd36-659e-47b6-8b42-0d7c608aa3ba tempest-VolumesActionsTest-1292551954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ad382ce3-d94a-434d-9a6c-13957956a23b" returned: 0 in 0.568s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:56 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea 1073741824 Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c076fd36-659e-47b6-8b42-0d7c608aa3ba tempest-VolumesActionsTest-1292551954 None] Lock "cinder-quobyte-ad382ce3-d94a-434d-9a6c-13957956a23b" released by "delete_volume" :: held 1.202s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:11:56 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-c076fd36-659e-47b6-8b42-0d7c608aa3ba tempest-VolumesActionsTest-1292551954 None] Created reservations ['cd0f5213-8262-4e01-922b-c6bd7fe9d6e4', 'bf83460a-4420-4541-a257-fb85d2c26d7d', '54b68ca4-c8bc-4623-aad6-4866232149cd', '91af80e8-5f20-4838-a782-56e8f6a3fd60'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c076fd36-659e-47b6-8b42-0d7c608aa3ba tempest-VolumesActionsTest-1292551954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c076fd36-659e-47b6-8b42-0d7c608aa3ba tempest-VolumesActionsTest-1292551954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c076fd36-659e-47b6-8b42-0d7c608aa3ba tempest-VolumesActionsTest-1292551954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c076fd36-659e-47b6-8b42-0d7c608aa3ba tempest-VolumesActionsTest-1292551954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c076fd36-659e-47b6-8b42-0d7c608aa3ba tempest-VolumesActionsTest-1292551954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c076fd36-659e-47b6-8b42-0d7c608aa3ba tempest-VolumesActionsTest-1292551954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:56 devstack sudo[88030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:11:56 devstack sudo[88030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:57 devstack sudo[88030]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c076fd36-659e-47b6-8b42-0d7c608aa3ba tempest-VolumesActionsTest-1292551954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.514s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-c076fd36-659e-47b6-8b42-0d7c608aa3ba tempest-VolumesActionsTest-1292551954 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:11:57 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-c076fd36-659e-47b6-8b42-0d7c608aa3ba tempest-VolumesActionsTest-1292551954 None] Deleted volume successfully. Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:11:57 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Flow 'volume_create_manager' (4c95ac28-1267-406a-b6a1-d13d84f32cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f196f221-6d07-4f02-b874-0c04708e5c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c076fd36-659e-47b6-8b42-0d7c608aa3ba tempest-VolumesActionsTest-1292551954 None] Lock "cinder-ad382ce3-d94a-434d-9a6c-13957956a23b-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea 1073741824" returned: 0 in 0.718s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f196f221-6d07-4f02-b874-0c04708e5c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-537376363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da3a2f9-df13-47ff-bc2b-5b13190c9f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c359b6b4b2eb46ebbbbe0db9cf531759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:11:57Z,use_quota=True,user_id='9d2afefc40514b23bb18d5b2749f6b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3f7d96-5984-4a85-83f0-8325f9e83178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3f7d96-5984-4a85-83f0-8325f9e83178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fc2e3f-f013-4227-96dd-83a898f0af2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fc2e3f-f013-4227-96dd-83a898f0af2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0da3a2f9-df13-47ff-bc2b-5b13190c9f77', 'volume_name': 'volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41464d8a-66de-4e05-a73d-12837b6f0567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41464d8a-66de-4e05-a73d-12837b6f0567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee45b6d4-1900-4e44-8846-fbba330add5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:57 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Volume 0da3a2f9-df13-47ff-bc2b-5b13190c9f77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77', 'volume_size': 1} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:57 devstack sudo[88036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea Apr 27 10:11:57 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:57 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea" returned: 0 in 0.440s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.471s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-537376363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da3a2f9-df13-47ff-bc2b-5b13190c9f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c359b6b4b2eb46ebbbbe0db9cf531759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:11:57Z,use_quota=True,user_id='9d2afefc40514b23bb18d5b2749f6b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Creating volume 0da3a2f9-df13-47ff-bc2b-5b13190c9f77 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:11:57 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:57 devstack sudo[88039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77 1073741824 Apr 27 10:11:57 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17084b59-c026-4435-8038-c0ae902e7598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa7598bc-29a0-4af4-b008-6df57f9d6582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:57 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Volume volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea (f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea): created successfully Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa7598bc-29a0-4af4-b008-6df57f9d6582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Flow 'volume_create_manager' (adccbaef-820e-4a11-9270-4d0620416f51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:11:57 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-8a0aa6ec-7e32-4d11-9339-c58989e243f6 tempest-GroupSnapshotsTest-2035960321 None] Created volume successfully. Apr 27 10:11:58 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77 1073741824" returned: 0 in 0.697s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:58 devstack sudo[88044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77 Apr 27 10:11:58 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:58 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:58 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Flow 'volume_create_manager' (34997595-6f2a-48af-bae9-519e6582751f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7de6ab4-9581-42bc-9890-ded6eb9ea788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77" returned: 0 in 0.604s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee45b6d4-1900-4e44-8846-fbba330add5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43711afe-4dbe-4f7f-b9c3-a78d0f3727a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7de6ab4-9581-42bc-9890-ded6eb9ea788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-218365729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57accf21-1c5b-48ae-9236-1c67f1819141,host='devstack@QuobyteHD#QuobyteHD',id=5949f5a3-a5b6-4b7e-81c7-d16b4404afd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339a6b64c6b94ca98cef7fcca0a2f4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:11:59Z,use_quota=True,user_id='29c0afff810a4c0387dee9391a78ef21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0afee686-718b-4c26-af06-11a038ad5fd1),volume_type_id=0afee686-718b-4c26-af06-11a038ad5fd1)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7f2021-4c2b-4592-aa9e-6059117463b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7f2021-4c2b-4592-aa9e-6059117463b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff858dbe-5063-427d-8822-a175f35c74f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff858dbe-5063-427d-8822-a175f35c74f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5949f5a3-a5b6-4b7e-81c7-d16b4404afd9', 'volume_name': 'volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d011e0c-8a7c-4bc5-97b6-f3f24911c0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d011e0c-8a7c-4bc5-97b6-f3f24911c0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b68b89-bd92-4901-a374-eb52c2cc55ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:11:59 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Volume 5949f5a3-a5b6-4b7e-81c7-d16b4404afd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9', 'volume_size': 1} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=57accf21-1c5b-48ae-9236-1c67f1819141,created_at=2026-04-27T08:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-218365729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57accf21-1c5b-48ae-9236-1c67f1819141,host='devstack@QuobyteHD#QuobyteHD',id=5949f5a3-a5b6-4b7e-81c7-d16b4404afd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339a6b64c6b94ca98cef7fcca0a2f4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:11:59Z,use_quota=True,user_id='29c0afff810a4c0387dee9391a78ef21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0afee686-718b-4c26-af06-11a038ad5fd1),volume_type_id=0afee686-718b-4c26-af06-11a038ad5fd1)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Creating volume 5949f5a3-a5b6-4b7e-81c7-d16b4404afd9 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:11:59 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:59 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Volume volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77 (0da3a2f9-df13-47ff-bc2b-5b13190c9f77): created successfully Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43711afe-4dbe-4f7f-b9c3-a78d0f3727a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Flow 'volume_create_manager' (4c95ac28-1267-406a-b6a1-d13d84f32cd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:11:59 devstack sudo[88048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9 1073741824 Apr 27 10:11:59 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:11:59 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-085071a2-0ac5-4dd5-bd7d-f72e15fc755b tempest-VolumesDeleteCascade-1152200705 None] Created volume successfully. Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8605cae4-af5b-45c1-8fe8-5b46b54a44a6 tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:11:59 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9 1073741824" returned: 0 in 0.707s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:11:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:11:59 devstack sudo[88053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9 Apr 27 10:11:59 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:00 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9" returned: 0 in 0.533s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:00 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:12:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8605cae4-af5b-45c1-8fe8-5b46b54a44a6 tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.924s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:00 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-8605cae4-af5b-45c1-8fe8-5b46b54a44a6 tempest-VolumesDeleteCascade-1152200705 None] Creating offline snapshot ee17e2e2-98c8-4d01-aec6-2d45f467189a of volume 0da3a2f9-df13-47ff-bc2b-5b13190c9f77 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:12:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b68b89-bd92-4901-a374-eb52c2cc55ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e4eb476-e1f2-449c-b132-03979ed4baed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:00 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde487ff-4454-4c6f-8fc2-ffbe1cff8033]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8605cae4-af5b-45c1-8fe8-5b46b54a44a6 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:00 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Volume volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9 (5949f5a3-a5b6-4b7e-81c7-d16b4404afd9): created successfully Apr 27 10:12:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e4eb476-e1f2-449c-b132-03979ed4baed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Flow 'volume_create_manager' (34997595-6f2a-48af-bae9-519e6582751f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:12:00 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-462c45be-ab2a-40c8-a2aa-d9e7c8746f3e tempest-GroupSnapshotsTest-2035960321 None] Created volume successfully. Apr 27 10:12:00 devstack sudo[88056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77 Apr 27 10:12:00 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:01 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8605cae4-af5b-45c1-8fe8-5b46b54a44a6 tempest-VolumesDeleteCascade-1152200705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77" returned: 0 in 0.604s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8605cae4-af5b-45c1-8fe8-5b46b54a44a6 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:01 devstack sudo[88062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a 1G Apr 27 10:12:01 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:01 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-c3960802-49cc-4dbc-b2d9-8bdfedb6ddd0 tempest-GroupSnapshotsTest-2035960321 None] Update group completed successfully. Apr 27 10:12:01 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8605cae4-af5b-45c1-8fe8-5b46b54a44a6 tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a 1G" returned: 0 in 0.743s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8605cae4-af5b-45c1-8fe8-5b46b54a44a6 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:01 devstack sudo[88067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a Apr 27 10:12:01 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:02 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8605cae4-af5b-45c1-8fe8-5b46b54a44a6 tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a" returned: 0 in 0.508s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:02 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-8605cae4-af5b-45c1-8fe8-5b46b54a44a6 tempest-VolumesDeleteCascade-1152200705 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a is being set with open permissions: ugo+rw Apr 27 10:12:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8605cae4-af5b-45c1-8fe8-5b46b54a44a6 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:02 devstack sudo[88072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a Apr 27 10:12:02 devstack sudo[88072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:02 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-f4e9359b-509f-4db1-a7c0-f45033aa295a tempest-GroupSnapshotsTest-2035960321 None] Update group completed successfully. Apr 27 10:12:02 devstack sudo[88072]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8605cae4-af5b-45c1-8fe8-5b46b54a44a6 tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a" returned: 0 in 0.544s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8605cae4-af5b-45c1-8fe8-5b46b54a44a6 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:02 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.info Apr 27 10:12:02 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:02 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:12:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Flow 'volume_create_manager' (b282fdff-5f10-454d-9ec7-9a8696b79f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:12:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952c3a2f-e3c2-4697-ae90-dcf4110d1096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952c3a2f-e3c2-4697-ae90-dcf4110d1096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1513412800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bf0b185-83de-4b84-89a9-8dcdd6f8e517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55611cf9697f4e6c968f7c25bcafd9ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:12:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:12:03Z,use_quota=True,user_id='54f5d6151ad3410896feda9445a7c041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77bb3e1b-8338-480a-9852-3f24f206ced6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77bb3e1b-8338-480a-9852-3f24f206ced6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef4ac494-c8dd-4af2-becf-25068737a6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef4ac494-c8dd-4af2-becf-25068737a6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bf0b185-83de-4b84-89a9-8dcdd6f8e517', 'volume_name': 'volume-4bf0b185-83de-4b84-89a9-8dcdd6f8e517', 'volume_size': 2}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f398e2-e9e5-46eb-a003-9dc5cd22bf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f398e2-e9e5-46eb-a003-9dc5cd22bf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6660f178-be64-43a6-b239-12901431e31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:02 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Volume 4bf0b185-83de-4b84-89a9-8dcdd6f8e517: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bf0b185-83de-4b84-89a9-8dcdd6f8e517', 'volume_size': 2} Apr 27 10:12:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:03 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8605cae4-af5b-45c1-8fe8-5b46b54a44a6 tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.info" returned: 0 in 0.471s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:03 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-8605cae4-af5b-45c1-8fe8-5b46b54a44a6 tempest-VolumesDeleteCascade-1152200705 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.info is being set with open permissions: ugo+rw Apr 27 10:12:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8605cae4-af5b-45c1-8fe8-5b46b54a44a6 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:03 devstack sudo[88078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.info Apr 27 10:12:03 devstack sudo[88078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:03 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-443d5d08-7245-4cd2-ad9f-c6aea6ec23a6 tempest-GroupSnapshotsTest-2035960321 None] Update group completed successfully. Apr 27 10:12:03 devstack sudo[88078]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8605cae4-af5b-45c1-8fe8-5b46b54a44a6 tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.info" returned: 0 in 0.472s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8605cae4-af5b-45c1-8fe8-5b46b54a44a6 tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.450s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.869s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1513412800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bf0b185-83de-4b84-89a9-8dcdd6f8e517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55611cf9697f4e6c968f7c25bcafd9ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:12:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:12:03Z,use_quota=True,user_id='54f5d6151ad3410896feda9445a7c041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:12:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Creating volume 4bf0b185-83de-4b84-89a9-8dcdd6f8e517 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:12:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:12:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:12:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:12:03 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:12:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4bf0b185-83de-4b84-89a9-8dcdd6f8e517 2147483648 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:03 devstack sudo[88081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4bf0b185-83de-4b84-89a9-8dcdd6f8e517 2147483648 Apr 27 10:12:03 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:03 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-8605cae4-af5b-45c1-8fe8-5b46b54a44a6 tempest-VolumesDeleteCascade-1152200705 None] Create snapshot completed successfully Apr 27 10:12:04 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4bf0b185-83de-4b84-89a9-8dcdd6f8e517 2147483648" returned: 0 in 0.637s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4bf0b185-83de-4b84-89a9-8dcdd6f8e517 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:04 devstack sudo[88086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4bf0b185-83de-4b84-89a9-8dcdd6f8e517 Apr 27 10:12:04 devstack sudo[88086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8c0e7705-f660-4c6a-a23c-18fcc874a3b0 tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:04 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-fa71a9f6-d699-4051-8aea-21a324cfe447 tempest-GroupSnapshotsTest-2035960321 None] Update group completed successfully. Apr 27 10:12:04 devstack sudo[88086]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4bf0b185-83de-4b84-89a9-8dcdd6f8e517" returned: 0 in 0.483s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:04 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:12:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8c0e7705-f660-4c6a-a23c-18fcc874a3b0 tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.116s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:04 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-8c0e7705-f660-4c6a-a23c-18fcc874a3b0 tempest-VolumesDeleteCascade-1152200705 None] Creating offline snapshot 165ae4ee-53ff-4e18-8d23-03dd5f3cff4d of volume 0da3a2f9-df13-47ff-bc2b-5b13190c9f77 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:12:05 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6660f178-be64-43a6-b239-12901431e31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bf0b185-83de-4b84-89a9-8dcdd6f8e517', 'volume_size': 2}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:05 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c437715-a12c-41c1-a482-e44f5381a686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:05 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9314c6-e2ac-4c25-8140-4f29d23a52b8]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c0e7705-f660-4c6a-a23c-18fcc874a3b0 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:05 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Volume volume-4bf0b185-83de-4b84-89a9-8dcdd6f8e517 (4bf0b185-83de-4b84-89a9-8dcdd6f8e517): created successfully Apr 27 10:12:05 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c437715-a12c-41c1-a482-e44f5381a686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:05 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Flow 'volume_create_manager' (b282fdff-5f10-454d-9ec7-9a8696b79f3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:12:05 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-062b9e88-1943-4347-b7cc-2bba22f430c5 tempest-VolumesCloneNegativeTest-735555482 None] Created volume successfully. Apr 27 10:12:05 devstack sudo[88090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a Apr 27 10:12:05 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:05 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c0e7705-f660-4c6a-a23c-18fcc874a3b0 tempest-VolumesDeleteCascade-1152200705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a" returned: 0 in 0.512s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:05 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-8c0e7705-f660-4c6a-a23c-18fcc874a3b0 tempest-VolumesDeleteCascade-1152200705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:12:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c0e7705-f660-4c6a-a23c-18fcc874a3b0 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.165ae4ee-53ff-4e18-8d23-03dd5f3cff4d 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:05 devstack sudo[88095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.165ae4ee-53ff-4e18-8d23-03dd5f3cff4d 1G Apr 27 10:12:05 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:06 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c2f9ad53-cb35-4433-bba2-fdc9a24cd493 tempest-VolumesCloneNegativeTest-735555482 None] Acquiring lock "cinder-4bf0b185-83de-4b84-89a9-8dcdd6f8e517-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c0e7705-f660-4c6a-a23c-18fcc874a3b0 tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.165ae4ee-53ff-4e18-8d23-03dd5f3cff4d 1G" returned: 0 in 0.690s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c0e7705-f660-4c6a-a23c-18fcc874a3b0 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.165ae4ee-53ff-4e18-8d23-03dd5f3cff4d {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c2f9ad53-cb35-4433-bba2-fdc9a24cd493 tempest-VolumesCloneNegativeTest-735555482 None] Lock "cinder-4bf0b185-83de-4b84-89a9-8dcdd6f8e517-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:06 devstack sudo[88100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.165ae4ee-53ff-4e18-8d23-03dd5f3cff4d Apr 27 10:12:06 devstack sudo[88100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:06 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] GroupSnapshot 06e02dd2-1864-4716-bb99-b42c3a618c5f: creating. Apr 27 10:12:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c2f9ad53-cb35-4433-bba2-fdc9a24cd493 tempest-VolumesCloneNegativeTest-735555482 None] Acquiring lock "cinder-quobyte-4bf0b185-83de-4b84-89a9-8dcdd6f8e517" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] Group snapshot 06e02dd2-1864-4716-bb99-b42c3a618c5f: creating. {{(pid=81350) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 27 10:12:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c2f9ad53-cb35-4433-bba2-fdc9a24cd493 tempest-VolumesCloneNegativeTest-735555482 None] Lock "cinder-quobyte-4bf0b185-83de-4b84-89a9-8dcdd6f8e517" acquired by "delete_volume" :: waited 0.020s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:06 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[30600a79-4f03-4f99-be56-13ddf0a6be7a]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c2f9ad53-cb35-4433-bba2-fdc9a24cd493 tempest-VolumesCloneNegativeTest-735555482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4bf0b185-83de-4b84-89a9-8dcdd6f8e517 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:06 devstack sudo[88102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4bf0b185-83de-4b84-89a9-8dcdd6f8e517 Apr 27 10:12:06 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:06 devstack sudo[88100]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c0e7705-f660-4c6a-a23c-18fcc874a3b0 tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.165ae4ee-53ff-4e18-8d23-03dd5f3cff4d" returned: 0 in 0.530s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:06 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-8c0e7705-f660-4c6a-a23c-18fcc874a3b0 tempest-VolumesDeleteCascade-1152200705 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.165ae4ee-53ff-4e18-8d23-03dd5f3cff4d is being set with open permissions: ugo+rw Apr 27 10:12:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c0e7705-f660-4c6a-a23c-18fcc874a3b0 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.165ae4ee-53ff-4e18-8d23-03dd5f3cff4d {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:06 devstack sudo[88107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.165ae4ee-53ff-4e18-8d23-03dd5f3cff4d Apr 27 10:12:06 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:06 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c2f9ad53-cb35-4433-bba2-fdc9a24cd493 tempest-VolumesCloneNegativeTest-735555482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4bf0b185-83de-4b84-89a9-8dcdd6f8e517" returned: 0 in 0.530s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c2f9ad53-cb35-4433-bba2-fdc9a24cd493 tempest-VolumesCloneNegativeTest-735555482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4bf0b185-83de-4b84-89a9-8dcdd6f8e517 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:06 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4bf0b185-83de-4b84-89a9-8dcdd6f8e517 Apr 27 10:12:06 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:07 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c0e7705-f660-4c6a-a23c-18fcc874a3b0 tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.165ae4ee-53ff-4e18-8d23-03dd5f3cff4d" returned: 0 in 0.462s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8c0e7705-f660-4c6a-a23c-18fcc874a3b0 tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.299s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.901s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:07 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] Creating offline snapshot 7f7949ac-0ae2-42ab-bc68-a695b92641a6 of volume 5949f5a3-a5b6-4b7e-81c7-d16b4404afd9 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:12:07 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-8c0e7705-f660-4c6a-a23c-18fcc874a3b0 tempest-VolumesDeleteCascade-1152200705 None] Create snapshot completed successfully Apr 27 10:12:07 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[428cf205-c356-4eb9-b629-134f4e20dbd3]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:07 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c2f9ad53-cb35-4433-bba2-fdc9a24cd493 tempest-VolumesCloneNegativeTest-735555482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4bf0b185-83de-4b84-89a9-8dcdd6f8e517" returned: 0 in 0.465s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:07 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c2f9ad53-cb35-4433-bba2-fdc9a24cd493 tempest-VolumesCloneNegativeTest-735555482 None] Lock "cinder-quobyte-4bf0b185-83de-4b84-89a9-8dcdd6f8e517" released by "delete_volume" :: held 1.037s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:07 devstack sudo[88116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9 Apr 27 10:12:07 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:07 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-c2f9ad53-cb35-4433-bba2-fdc9a24cd493 tempest-VolumesCloneNegativeTest-735555482 None] Created reservations ['21a44547-ec44-49cc-9d4e-61af66ba756d', 'f19c9674-cf78-468c-870c-513ef4de221e', 'c251eeb5-b696-4d05-ab6a-5870283f04e9', '5160d174-06f3-46fb-a1a0-906cd101b069'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:12:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c2f9ad53-cb35-4433-bba2-fdc9a24cd493 tempest-VolumesCloneNegativeTest-735555482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c2f9ad53-cb35-4433-bba2-fdc9a24cd493 tempest-VolumesCloneNegativeTest-735555482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:07 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c2f9ad53-cb35-4433-bba2-fdc9a24cd493 tempest-VolumesCloneNegativeTest-735555482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:12:07 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c2f9ad53-cb35-4433-bba2-fdc9a24cd493 tempest-VolumesCloneNegativeTest-735555482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:12:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c2f9ad53-cb35-4433-bba2-fdc9a24cd493 tempest-VolumesCloneNegativeTest-735555482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c2f9ad53-cb35-4433-bba2-fdc9a24cd493 tempest-VolumesCloneNegativeTest-735555482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:07 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:12:07 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:07 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9" returned: 0 in 0.587s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.7f7949ac-0ae2-42ab-bc68-a695b92641a6 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:07 devstack sudo[88124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.7f7949ac-0ae2-42ab-bc68-a695b92641a6 1G Apr 27 10:12:07 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:08 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "cinder-0da3a2f9-df13-47ff-bc2b-5b13190c9f77-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c2f9ad53-cb35-4433-bba2-fdc9a24cd493 tempest-VolumesCloneNegativeTest-735555482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.531s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:08 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-c2f9ad53-cb35-4433-bba2-fdc9a24cd493 tempest-VolumesCloneNegativeTest-735555482 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:12:08 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-c2f9ad53-cb35-4433-bba2-fdc9a24cd493 tempest-VolumesCloneNegativeTest-735555482 None] Deleted volume successfully. Apr 27 10:12:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-0da3a2f9-df13-47ff-bc2b-5b13190c9f77-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c2f9ad53-cb35-4433-bba2-fdc9a24cd493 tempest-VolumesCloneNegativeTest-735555482 None] Lock "cinder-4bf0b185-83de-4b84-89a9-8dcdd6f8e517-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Performing cascade delete. {{(pid=81350) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 27 10:12:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "cinder-165ae4ee-53ff-4e18-8d23-03dd5f3cff4d-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-165ae4ee-53ff-4e18-8d23-03dd5f3cff4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "cinder-quobyte-0da3a2f9-df13-47ff-bc2b-5b13190c9f77" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-quobyte-0da3a2f9-df13-47ff-bc2b-5b13190c9f77" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "cinder-quobyte-165ae4ee-53ff-4e18-8d23-03dd5f3cff4d" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-quobyte-165ae4ee-53ff-4e18-8d23-03dd5f3cff4d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Deleting offline snapshot 165ae4ee-53ff-4e18-8d23-03dd5f3cff4d of volume 0da3a2f9-df13-47ff-bc2b-5b13190c9f77 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:12:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] snapshot_file for this snap is: volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.165ae4ee-53ff-4e18-8d23-03dd5f3cff4d {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:12:08 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb3782d-1a7d-4f8c-9532-d9a8889ba04f]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.165ae4ee-53ff-4e18-8d23-03dd5f3cff4d {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:08 devstack sudo[88127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.165ae4ee-53ff-4e18-8d23-03dd5f3cff4d Apr 27 10:12:08 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:08 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.7f7949ac-0ae2-42ab-bc68-a695b92641a6 1G" returned: 0 in 0.684s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.7f7949ac-0ae2-42ab-bc68-a695b92641a6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:08 devstack sudo[88132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.7f7949ac-0ae2-42ab-bc68-a695b92641a6 Apr 27 10:12:08 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:08 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.165ae4ee-53ff-4e18-8d23-03dd5f3cff4d" returned: 0 in 0.624s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:12:08 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a60cb4-f095-4913-bd91-544bd6269ab5]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:08 devstack sudo[88137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a Apr 27 10:12:08 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:09 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.7f7949ac-0ae2-42ab-bc68-a695b92641a6" returned: 0 in 0.620s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:09 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.7f7949ac-0ae2-42ab-bc68-a695b92641a6 is being set with open permissions: ugo+rw: NotImplementedError Apr 27 10:12:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.7f7949ac-0ae2-42ab-bc68-a695b92641a6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:09 devstack sudo[88142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.7f7949ac-0ae2-42ab-bc68-a695b92641a6 Apr 27 10:12:09 devstack sudo[88142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:09 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a" returned: 0 in 0.628s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:09 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:12:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.165ae4ee-53ff-4e18-8d23-03dd5f3cff4d {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:09 devstack sudo[88147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.165ae4ee-53ff-4e18-8d23-03dd5f3cff4d Apr 27 10:12:09 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:09 devstack sudo[88142]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.7f7949ac-0ae2-42ab-bc68-a695b92641a6" returned: 0 in 0.538s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:09 devstack sudo[88150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.info Apr 27 10:12:09 devstack sudo[88150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:10 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.165ae4ee-53ff-4e18-8d23-03dd5f3cff4d" returned: 0 in 0.654s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.165ae4ee-53ff-4e18-8d23-03dd5f3cff4d {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:10 devstack sudo[88155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.165ae4ee-53ff-4e18-8d23-03dd5f3cff4d Apr 27 10:12:10 devstack sudo[88155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:10 devstack sudo[88150]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.info" returned: 0 in 0.555s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:10 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.info is being set with open permissions: ugo+rw: NotImplementedError Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:10 devstack sudo[88158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.info Apr 27 10:12:10 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:10 devstack sudo[88155]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.165ae4ee-53ff-4e18-8d23-03dd5f3cff4d" returned: 0 in 0.462s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-quobyte-165ae4ee-53ff-4e18-8d23-03dd5f3cff4d" released by "_delete_snapshot" :: held 2.455s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-quobyte-0da3a2f9-df13-47ff-bc2b-5b13190c9f77" released by "delete_snapshot" :: held 2.479s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Created reservations ['fd345eb4-3ef5-4629-a391-6b7e33d2a624', 'd41795f6-9ea8-44c5-88fc-88ae7b62888e', '48ec879d-c2a8-4cea-980c-1d7e13ef6bc2', 'b652232e-2962-4455-bf52-d91fdbf517a7'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:12:10 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Delete snapshot completed successfully. Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-165ae4ee-53ff-4e18-8d23-03dd5f3cff4d-delete_snapshot" released by "delete_snapshot" :: held 2.659s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "cinder-ee17e2e2-98c8-4d01-aec6-2d45f467189a-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:10 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.info" returned: 0 in 0.492s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.571s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-ee17e2e2-98c8-4d01-aec6-2d45f467189a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] Creating offline snapshot cb281a33-41c5-41ba-b7d3-8c9d7199bb63 of volume f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "cinder-quobyte-0da3a2f9-df13-47ff-bc2b-5b13190c9f77" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[694cee1a-33a2-47cc-9fc5-52c2d93f273e]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-quobyte-0da3a2f9-df13-47ff-bc2b-5b13190c9f77" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "cinder-quobyte-ee17e2e2-98c8-4d01-aec6-2d45f467189a" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-quobyte-ee17e2e2-98c8-4d01-aec6-2d45f467189a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Deleting offline snapshot ee17e2e2-98c8-4d01-aec6-2d45f467189a of volume 0da3a2f9-df13-47ff-bc2b-5b13190c9f77 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] snapshot_file for this snap is: volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:12:10 devstack sudo[88162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea Apr 27 10:12:10 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:10 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b3e879-d020-4b9b-aef8-9327ca25ab97]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:11 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:12:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Flow 'volume_create_manager' (243502dc-0dab-4c6f-9843-52f7bf53c9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:12:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7535b01a-850e-4ccc-82f4-b971952479c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7535b01a-850e-4ccc-82f4-b971952479c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1033767946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c7847c9-4330-4af6-8de7-894fc4edbeea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06210b7199bf4101948e053995631c71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:12:11Z,use_quota=True,user_id='4d8f8ee9ee994db6be008db5a3bb5c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc5f8d98-7767-4f28-b6a8-6e617a2442d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:11 devstack sudo[88164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a Apr 27 10:12:11 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc5f8d98-7767-4f28-b6a8-6e617a2442d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5427e54-3e58-4ee3-b19f-a63cb8db292d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5427e54-3e58-4ee3-b19f-a63cb8db292d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c7847c9-4330-4af6-8de7-894fc4edbeea', 'volume_name': 'volume-9c7847c9-4330-4af6-8de7-894fc4edbeea', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d96b6830-3ca9-4649-b233-fbbbc841e8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d96b6830-3ca9-4649-b233-fbbbc841e8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e55f623-3725-417f-a2dc-8cb38420075b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:11 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Volume 9c7847c9-4330-4af6-8de7-894fc4edbeea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c7847c9-4330-4af6-8de7-894fc4edbeea', 'volume_size': 1} Apr 27 10:12:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:11 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea" returned: 0 in 0.570s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.cb281a33-41c5-41ba-b7d3-8c9d7199bb63 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:11 devstack sudo[88172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.cb281a33-41c5-41ba-b7d3-8c9d7199bb63 1G Apr 27 10:12:11 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:11 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a" returned: 0 in 0.549s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:11 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:12:11 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c5623d-98c3-4af7-a4d6-4e54d91bbbec]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:11 devstack sudo[88174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77 Apr 27 10:12:11 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:12 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.cb281a33-41c5-41ba-b7d3-8c9d7199bb63 1G" returned: 0 in 0.594s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.cb281a33-41c5-41ba-b7d3-8c9d7199bb63 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:12 devstack sudo[88182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.cb281a33-41c5-41ba-b7d3-8c9d7199bb63 Apr 27 10:12:12 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:12 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77" returned: 0 in 0.566s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:12 devstack sudo[88184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a Apr 27 10:12:12 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:12 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.cb281a33-41c5-41ba-b7d3-8c9d7199bb63" returned: 0 in 0.527s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:12 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.cb281a33-41c5-41ba-b7d3-8c9d7199bb63 is being set with open permissions: ugo+rw: NotImplementedError Apr 27 10:12:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.cb281a33-41c5-41ba-b7d3-8c9d7199bb63 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:12 devstack sudo[88192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.cb281a33-41c5-41ba-b7d3-8c9d7199bb63 Apr 27 10:12:12 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:12 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a" returned: 0 in 0.551s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:12 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a Apr 27 10:12:12 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:13 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.cb281a33-41c5-41ba-b7d3-8c9d7199bb63" returned: 0 in 0.461s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:13 devstack sudo[88198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.info Apr 27 10:12:13 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:13 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77.ee17e2e2-98c8-4d01-aec6-2d45f467189a" returned: 0 in 0.438s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-quobyte-ee17e2e2-98c8-4d01-aec6-2d45f467189a" released by "_delete_snapshot" :: held 2.206s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-quobyte-0da3a2f9-df13-47ff-bc2b-5b13190c9f77" released by "delete_snapshot" :: held 2.234s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:13 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Created reservations ['29a80360-22e8-4473-83f5-914fbae10767', '76e6dcf4-3842-4316-a2d6-1854c30b7e9b', 'd5b1b9b6-2433-4ffa-8d24-5daf761c4ae1', 'f86ffa83-a6fd-48c4-837e-8f6e7eceabdf'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:12:13 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Delete snapshot completed successfully. Apr 27 10:12:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-ee17e2e2-98c8-4d01-aec6-2d45f467189a-delete_snapshot" released by "delete_snapshot" :: held 2.417s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Snapshots deleted, issuing volume delete {{(pid=81350) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 27 10:12:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "cinder-quobyte-0da3a2f9-df13-47ff-bc2b-5b13190c9f77" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-quobyte-0da3a2f9-df13-47ff-bc2b-5b13190c9f77" acquired by "delete_volume" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:13 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9774a9-91cd-4c7b-bb6b-57d4d7ed1dd2]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:13 devstack sudo[88200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77 Apr 27 10:12:13 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:13 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.info" returned: 0 in 0.487s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:13 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.info is being set with open permissions: ugo+rw: NotImplementedError Apr 27 10:12:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:13 devstack sudo[88203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.info Apr 27 10:12:13 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:13 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77" returned: 0 in 0.560s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:13 devstack sudo[88208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77 Apr 27 10:12:13 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:14 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.info" returned: 0 in 0.446s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.178s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.938s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1033767946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c7847c9-4330-4af6-8de7-894fc4edbeea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06210b7199bf4101948e053995631c71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:12:11Z,use_quota=True,user_id='4d8f8ee9ee994db6be008db5a3bb5c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Creating volume 9c7847c9-4330-4af6-8de7-894fc4edbeea {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:12:14 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9c7847c9-4330-4af6-8de7-894fc4edbeea 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:14 devstack sudo[88211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9c7847c9-4330-4af6-8de7-894fc4edbeea 1073741824 Apr 27 10:12:14 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:14 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-d6cc1a3b-d054-4918-8211-049bf751efeb tempest-GroupSnapshotsTest-2035960321 None] group_snapshot 06e02dd2-1864-4716-bb99-b42c3a618c5f: created successfully Apr 27 10:12:14 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0da3a2f9-df13-47ff-bc2b-5b13190c9f77" returned: 0 in 0.459s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-quobyte-0da3a2f9-df13-47ff-bc2b-5b13190c9f77" released by "delete_volume" :: held 1.069s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Created reservations ['63a4679e-8757-4202-abc3-210af3552c6a', '28ac8231-4fb1-4800-a36a-011e02348bf5', '531f7dcb-671c-4c8f-a55b-239b17ef14b2', 'f2bf1507-d10a-4dc8-bfe6-2919b998a5d2'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:14 devstack sudo[88217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:12:14 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:14 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9c7847c9-4330-4af6-8de7-894fc4edbeea 1073741824" returned: 0 in 0.722s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:14 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] group_snapshot 06e02dd2-1864-4716-bb99-b42c3a618c5f: deleting Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] group_snapshot 06e02dd2-1864-4716-bb99-b42c3a618c5f: deleting {{(pid=81350) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9c7847c9-4330-4af6-8de7-894fc4edbeea {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "cinder-quobyte-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:14 devstack sudo[88220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9c7847c9-4330-4af6-8de7-894fc4edbeea Apr 27 10:12:14 devstack sudo[88220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "cinder-quobyte-7f7949ac-0ae2-42ab-bc68-a695b92641a6" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-7f7949ac-0ae2-42ab-bc68-a695b92641a6" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Deleting offline snapshot 7f7949ac-0ae2-42ab-bc68-a695b92641a6 of volume 5949f5a3-a5b6-4b7e-81c7-d16b4404afd9 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] snapshot_file for this snap is: volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.7f7949ac-0ae2-42ab-bc68-a695b92641a6 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5f9995-f21e-4bea-b190-c8edf95ba88d]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.7f7949ac-0ae2-42ab-bc68-a695b92641a6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:15 devstack sudo[88229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.7f7949ac-0ae2-42ab-bc68-a695b92641a6 Apr 27 10:12:15 devstack sudo[88229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:15 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.522s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:15 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:12:15 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Deleted volume successfully. Apr 27 10:12:15 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2f14171-7350-40ec-91c4-b58a038d94ce tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-0da3a2f9-df13-47ff-bc2b-5b13190c9f77-delete_volume" released by "delete_volume" :: held 6.968s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:15 devstack sudo[88220]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9c7847c9-4330-4af6-8de7-894fc4edbeea" returned: 0 in 0.536s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:15 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:12:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:15 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e55f623-3725-417f-a2dc-8cb38420075b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c7847c9-4330-4af6-8de7-894fc4edbeea', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:15 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1b105a4-de4b-4ed9-a49b-588baba20aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:15 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Volume volume-9c7847c9-4330-4af6-8de7-894fc4edbeea (9c7847c9-4330-4af6-8de7-894fc4edbeea): created successfully Apr 27 10:12:15 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1b105a4-de4b-4ed9-a49b-588baba20aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:15 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Flow 'volume_create_manager' (243502dc-0dab-4c6f-9843-52f7bf53c9af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:12:15 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-3cd4e055-b8cc-4bbb-927a-a112e9ea461f tempest-VolumesNegativeTest-1388619715 None] Created volume successfully. Apr 27 10:12:15 devstack sudo[88229]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.7f7949ac-0ae2-42ab-bc68-a695b92641a6" returned: 0 in 0.540s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:15 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:12:15 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88d34a5-4a9e-4442-9e33-bfbb23c52997]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:15 devstack sudo[88235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9 Apr 27 10:12:15 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Flow 'volume_create_manager' (29bfbac4-9cde-4ca5-bda4-016efd4ab0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a362811c-015f-4534-bcf2-c5b27d761738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:16 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9" returned: 0 in 0.568s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.7f7949ac-0ae2-42ab-bc68-a695b92641a6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a362811c-015f-4534-bcf2-c5b27d761738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1425982474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed57463-c468-454a-bb9f-f90abb009272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c359b6b4b2eb46ebbbbe0db9cf531759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:12:16Z,use_quota=True,user_id='9d2afefc40514b23bb18d5b2749f6b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:16 devstack sudo[88240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.7f7949ac-0ae2-42ab-bc68-a695b92641a6 Apr 27 10:12:16 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d608be59-1c94-4ef9-8a77-001bc98be674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d608be59-1c94-4ef9-8a77-001bc98be674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680fbf40-898b-46f3-a922-bcc437e5b252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680fbf40-898b-46f3-a922-bcc437e5b252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aed57463-c468-454a-bb9f-f90abb009272', 'volume_name': 'volume-aed57463-c468-454a-bb9f-f90abb009272', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25578985-489c-451b-aa63-62683524fc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25578985-489c-451b-aa63-62683524fc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebfa0925-42e7-4f70-9524-74d790514ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:16 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Volume aed57463-c468-454a-bb9f-f90abb009272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aed57463-c468-454a-bb9f-f90abb009272', 'volume_size': 1} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1425982474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed57463-c468-454a-bb9f-f90abb009272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c359b6b4b2eb46ebbbbe0db9cf531759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:12:16Z,use_quota=True,user_id='9d2afefc40514b23bb18d5b2749f6b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Creating volume aed57463-c468-454a-bb9f-f90abb009272 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:12:16 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:16 devstack sudo[88242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272 1073741824 Apr 27 10:12:16 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG oslo_service.periodic_task [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81350) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:16 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.7f7949ac-0ae2-42ab-bc68-a695b92641a6" returned: 0 in 0.593s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.7f7949ac-0ae2-42ab-bc68-a695b92641a6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:16 devstack sudo[88250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:12:16 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:16 devstack sudo[88251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.7f7949ac-0ae2-42ab-bc68-a695b92641a6 Apr 27 10:12:16 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:16 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272 1073741824" returned: 0 in 0.691s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:16 devstack sudo[88257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272 Apr 27 10:12:16 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:17 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9.7f7949ac-0ae2-42ab-bc68-a695b92641a6" returned: 0 in 0.557s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:17 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.597s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:17 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:12:17 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-7f7949ac-0ae2-42ab-bc68-a695b92641a6" released by "_delete_snapshot" :: held 2.375s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:17 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9" released by "delete_snapshot" :: held 2.401s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:17 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "cinder-quobyte-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:17 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:17 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "cinder-quobyte-cb281a33-41c5-41ba-b7d3-8c9d7199bb63" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:17 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-cb281a33-41c5-41ba-b7d3-8c9d7199bb63" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:17 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Deleting offline snapshot cb281a33-41c5-41ba-b7d3-8c9d7199bb63 of volume f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:12:17 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] snapshot_file for this snap is: volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.cb281a33-41c5-41ba-b7d3-8c9d7199bb63 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:12:17 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[350af707-71dd-4496-a20c-b785380dd5cf]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.cb281a33-41c5-41ba-b7d3-8c9d7199bb63 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:17 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272" returned: 0 in 0.540s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:17 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:12:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:17 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebfa0925-42e7-4f70-9524-74d790514ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aed57463-c468-454a-bb9f-f90abb009272', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:17 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9934a91e-df24-455c-9732-6bc6b0d3efc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:17 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Volume volume-aed57463-c468-454a-bb9f-f90abb009272 (aed57463-c468-454a-bb9f-f90abb009272): created successfully Apr 27 10:12:17 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9934a91e-df24-455c-9732-6bc6b0d3efc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:17 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Flow 'volume_create_manager' (29bfbac4-9cde-4ca5-bda4-016efd4ab0df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:12:17 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-29e9c33c-0ed6-4d5b-99d6-64422158b488 tempest-VolumesDeleteCascade-1152200705 None] Created volume successfully. Apr 27 10:12:17 devstack sudo[88262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.cb281a33-41c5-41ba-b7d3-8c9d7199bb63 Apr 27 10:12:17 devstack sudo[88262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:17 devstack sudo[88262]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.cb281a33-41c5-41ba-b7d3-8c9d7199bb63" returned: 0 in 0.577s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:17 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:12:17 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a0105f-bc6e-42ad-8686-df5fb37746c7]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:18 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea Apr 27 10:12:18 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ff9d6934-49ae-4934-8cad-60e7bf00b266 tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ff9d6934-49ae-4934-8cad-60e7bf00b266 tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:18 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-ff9d6934-49ae-4934-8cad-60e7bf00b266 tempest-VolumesDeleteCascade-1152200705 None] Creating offline snapshot 27fa54e2-a096-42bf-85a1-ffe5b829c872 of volume aed57463-c468-454a-bb9f-f90abb009272 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:12:18 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cbf4f7-42f2-4dae-9737-0e86baafb10c]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ff9d6934-49ae-4934-8cad-60e7bf00b266 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:18 devstack sudo[88272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272 Apr 27 10:12:18 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:18 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea" returned: 0 in 0.538s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.cb281a33-41c5-41ba-b7d3-8c9d7199bb63 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:18 devstack sudo[88275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.cb281a33-41c5-41ba-b7d3-8c9d7199bb63 Apr 27 10:12:18 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:18 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ff9d6934-49ae-4934-8cad-60e7bf00b266 tempest-VolumesDeleteCascade-1152200705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272" returned: 0 in 0.541s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ff9d6934-49ae-4934-8cad-60e7bf00b266 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.27fa54e2-a096-42bf-85a1-ffe5b829c872 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:18 devstack sudo[88283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.27fa54e2-a096-42bf-85a1-ffe5b829c872 1G Apr 27 10:12:18 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:19 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.cb281a33-41c5-41ba-b7d3-8c9d7199bb63" returned: 0 in 0.561s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.cb281a33-41c5-41ba-b7d3-8c9d7199bb63 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:19 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.cb281a33-41c5-41ba-b7d3-8c9d7199bb63 Apr 27 10:12:19 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:19 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea.cb281a33-41c5-41ba-b7d3-8c9d7199bb63" returned: 0 in 0.488s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:19 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ff9d6934-49ae-4934-8cad-60e7bf00b266 tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.27fa54e2-a096-42bf-85a1-ffe5b829c872 1G" returned: 0 in 0.630s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ff9d6934-49ae-4934-8cad-60e7bf00b266 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aed57463-c468-454a-bb9f-f90abb009272 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.27fa54e2-a096-42bf-85a1-ffe5b829c872 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:19 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-cb281a33-41c5-41ba-b7d3-8c9d7199bb63" released by "_delete_snapshot" :: held 2.271s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:19 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea" released by "delete_snapshot" :: held 2.298s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:19 devstack sudo[88291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aed57463-c468-454a-bb9f-f90abb009272 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.27fa54e2-a096-42bf-85a1-ffe5b829c872 Apr 27 10:12:19 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:19 devstack cinder-volume[81350]: WARNING cinder.quota [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-590679058 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-590679058, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:12:19 devstack cinder-volume[81350]: WARNING cinder.quota [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-590679058 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-590679058, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:12:19 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Created reservations ['ece83469-b77e-4937-a7fd-af425e06963c', 'a63564fd-a69b-45b5-bf32-1e51f0ad946c', 'a9a2e489-498a-465a-87a8-0a36f5b683c8', 'ab1477d6-1f03-48f1-9023-81675aa6ce46'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:12:19 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] Created reservations ['bd32f9f5-3168-4fc4-a811-10513cff0a2d', 'c5717c36-7ed8-4ba2-a2de-bfcc644e924d', '39994da3-7274-4d07-bb45-8961cb0c0e10', '460b30e6-60c4-43f2-b5f8-f183ed1c914b'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:12:19 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-df68e64a-29df-4b3b-ad82-2a14301d5a17 tempest-GroupSnapshotsTest-2035960321 None] group_snapshot 06e02dd2-1864-4716-bb99-b42c3a618c5f: deleted successfully Apr 27 10:12:20 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ff9d6934-49ae-4934-8cad-60e7bf00b266 tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aed57463-c468-454a-bb9f-f90abb009272 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.27fa54e2-a096-42bf-85a1-ffe5b829c872" returned: 0 in 0.492s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:20 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-ff9d6934-49ae-4934-8cad-60e7bf00b266 tempest-VolumesDeleteCascade-1152200705 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.27fa54e2-a096-42bf-85a1-ffe5b829c872 is being set with open permissions: ugo+rw Apr 27 10:12:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ff9d6934-49ae-4934-8cad-60e7bf00b266 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.27fa54e2-a096-42bf-85a1-ffe5b829c872 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:20 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.27fa54e2-a096-42bf-85a1-ffe5b829c872 Apr 27 10:12:20 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:20 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "cinder-quobyte-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:20 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9" acquired by "delete_volume" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:20 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b1cde0-cb11-4249-a05b-009ad3c5d986]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:20 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ff9d6934-49ae-4934-8cad-60e7bf00b266 tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.27fa54e2-a096-42bf-85a1-ffe5b829c872" returned: 0 in 0.530s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ff9d6934-49ae-4934-8cad-60e7bf00b266 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:20 devstack sudo[88299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9 Apr 27 10:12:20 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:20 devstack sudo[88300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.info Apr 27 10:12:20 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:21 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ff9d6934-49ae-4934-8cad-60e7bf00b266 tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.info" returned: 0 in 0.431s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:21 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-ff9d6934-49ae-4934-8cad-60e7bf00b266 tempest-VolumesDeleteCascade-1152200705 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.info is being set with open permissions: ugo+rw Apr 27 10:12:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ff9d6934-49ae-4934-8cad-60e7bf00b266 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:21 devstack sudo[88307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.info Apr 27 10:12:21 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:21 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9" returned: 0 in 0.525s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:21 devstack sudo[88309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9 Apr 27 10:12:21 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:21 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ff9d6934-49ae-4934-8cad-60e7bf00b266 tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.info" returned: 0 in 0.459s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ff9d6934-49ae-4934-8cad-60e7bf00b266 tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.168s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:21 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-ff9d6934-49ae-4934-8cad-60e7bf00b266 tempest-VolumesDeleteCascade-1152200705 None] Create snapshot completed successfully Apr 27 10:12:21 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9" returned: 0 in 0.507s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:21 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-5949f5a3-a5b6-4b7e-81c7-d16b4404afd9" released by "delete_volume" :: held 1.106s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:21 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "cinder-quobyte-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:21 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea" acquired by "delete_volume" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:21 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd492cbf-224c-4a6a-95ae-e09e0c08be0b]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:21 devstack sudo[88313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea Apr 27 10:12:21 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:22 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea" returned: 0 in 0.547s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:22 devstack sudo[88318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea Apr 27 10:12:22 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:22 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea" returned: 0 in 0.521s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:22 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-f45a3ecc-3e05-4f71-b5cb-2b35a75d89ea" released by "delete_volume" :: held 1.135s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:22 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] Created reservations ['a73cc2af-8002-4d45-a617-37dec79a730d'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:12:22 devstack cinder-volume[81350]: WARNING cinder.quota [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-590679058 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-590679058, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:12:22 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] Created reservations ['759ee29b-11dc-406f-913c-991c114af5e2', 'e64e3eb1-0042-45e6-b8b4-1a06e8a6770a', '36cdf4a5-90bc-46a0-a522-06f622dcaa64', '90ea1f27-d57e-4093-9d11-7e7f284d3365'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] Created reservations ['00d64129-1845-43b3-bda5-f9a7b1885785', 'fb52493a-3ee6-4dd3-8f82-4ba30c52788e', '54b4c69e-dae0-4b90-bed4-a0024e2d741f', '3e4fc952-dd74-4dff-8c3e-a36a4c69da56'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Flow 'volume_create_manager' (13286be0-a09d-41bc-bdf6-ee0325853377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b967bc0f-da95-4b86-a06e-03a395d98b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b967bc0f-da95-4b86-a06e-03a395d98b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1983652796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f07a93-f53b-4f28-803c-e1c8676c3646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c359b6b4b2eb46ebbbbe0db9cf531759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=27fa54e2-a096-42bf-85a1-ffe5b829c872,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:12:23Z,use_quota=True,user_id='9d2afefc40514b23bb18d5b2749f6b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81fa55b5-7fa1-4e70-b3ee-f7103d167423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81fa55b5-7fa1-4e70-b3ee-f7103d167423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d10540b3-e66b-4cac-b767-66410909381f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d10540b3-e66b-4cac-b767-66410909381f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '89f07a93-f53b-4f28-803c-e1c8676c3646', 'volume_name': 'volume-89f07a93-f53b-4f28-803c-e1c8676c3646', 'volume_size': 1, 'snapshot_id': '27fa54e2-a096-42bf-85a1-ffe5b829c872'}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d0d9b6-f265-4e28-a159-f47ab54d9a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d0d9b6-f265-4e28-a159-f47ab54d9a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d18f9a16-8c49-43a7-aea9-bec5343284e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:23 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Volume 89f07a93-f53b-4f28-803c-e1c8676c3646: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-89f07a93-f53b-4f28-803c-e1c8676c3646', 'volume_size': 1, 'snapshot_id': '27fa54e2-a096-42bf-85a1-ffe5b829c872'} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "cinder-quobyte-27fa54e2-a096-42bf-85a1-ffe5b829c872-89f07a93-f53b-4f28-803c-e1c8676c3646" by "_create_volume_from_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-quobyte-27fa54e2-a096-42bf-85a1-ffe5b829c872-89f07a93-f53b-4f28-803c-e1c8676c3646" acquired by "_create_volume_from_snapshot" :: waited 0.055s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Creating volume 89f07a93-f53b-4f28-803c-e1c8676c3646 from snapshot 27fa54e2-a096-42bf-85a1-ffe5b829c872 {{(pid=81350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "cinder-quobyte-89f07a93-f53b-4f28-803c-e1c8676c3646" by "_copy_volume_from_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-quobyte-89f07a93-f53b-4f28-803c-e1c8676c3646" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] snapshot: 27fa54e2-a096-42bf-85a1-ffe5b829c872, volume: 89f07a93-f53b-4f28-803c-e1c8676c3646, {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 27 10:12:23 devstack sudo[88322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:12:23 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[7345abca-33d9-4cc1-a7b6-ec86aeee7579]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.27fa54e2-a096-42bf-85a1-ffe5b829c872 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:23 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.27fa54e2-a096-42bf-85a1-ffe5b829c872 Apr 27 10:12:23 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:23 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.551s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:23 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:12:23 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-6f1e1a12-3c6e-4f7e-aedd-8ae32824b6e8 tempest-GroupSnapshotsTest-2035960321 None] Delete group completed successfully. Apr 27 10:12:24 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.27fa54e2-a096-42bf-85a1-ffe5b829c872" returned: 0 in 0.690s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:24 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aed57463-c468-454a-bb9f-f90abb009272(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:12:24 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272 {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 27 10:12:24 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Creating direct copy from snapshot {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 27 10:12:24 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdaf9fa-15f7-4dfd-8681-cb720afd4ec8]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:24 devstack sudo[88344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272 Apr 27 10:12:24 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:24 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-985dc545-43f9-4b6a-a34a-6dab10f14553 tempest-GroupSnapshotsTest-2035960321 None] Group tempest-GroupSnapshotsTest-Group-928889065: creating Apr 27 10:12:24 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-985dc545-43f9-4b6a-a34a-6dab10f14553 tempest-GroupSnapshotsTest-2035960321 None] Group tempest-GroupSnapshotsTest-Group-928889065: created successfully Apr 27 10:12:24 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-985dc545-43f9-4b6a-a34a-6dab10f14553 tempest-GroupSnapshotsTest-2035960321 None] Create group completed successfully. Apr 27 10:12:24 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272" returned: 0 in 0.622s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:24 devstack cinder-volume[81350]: DEBUG cinder.utils [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Path /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-89f07a93-f53b-4f28-803c-e1c8676c3646 not found in is_blk_device check {{(pid=81350) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 27 10:12:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-89f07a93-f53b-4f28-803c-e1c8676c3646 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:24 devstack sudo[88351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-89f07a93-f53b-4f28-803c-e1c8676c3646 Apr 27 10:12:24 devstack sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:26 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:12:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Flow 'volume_create_manager' (d59cc3d0-332a-40ef-8e6d-52e6245555e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:12:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b59e7e-94fb-4af1-ba3a-d438faccfc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b59e7e-94fb-4af1-ba3a-d438faccfc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-472053941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=01d78bf3-cd7b-41c8-b519-cebf72db5934,host='devstack@QuobyteHD#QuobyteHD',id=42985153-05bf-46f8-a2f9-fc7dfd152d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339a6b64c6b94ca98cef7fcca0a2f4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:12:26Z,use_quota=True,user_id='29c0afff810a4c0387dee9391a78ef21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b62fcf-0b24-4d74-80a3-323a46cf419c),volume_type_id=69b62fcf-0b24-4d74-80a3-323a46cf419c)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e36366-d5c4-4e75-8b2b-5799bbc6a817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e36366-d5c4-4e75-8b2b-5799bbc6a817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d81b7f1-11a9-4ccd-845b-7934f56942aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d81b7f1-11a9-4ccd-845b-7934f56942aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42985153-05bf-46f8-a2f9-fc7dfd152d92', 'volume_name': 'volume-42985153-05bf-46f8-a2f9-fc7dfd152d92', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c3e46a-b482-4dd8-a3be-f3789371ecf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c3e46a-b482-4dd8-a3be-f3789371ecf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f438d75-e489-4923-b391-0d13ef8191cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:26 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Volume 42985153-05bf-46f8-a2f9-fc7dfd152d92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42985153-05bf-46f8-a2f9-fc7dfd152d92', 'volume_size': 1} Apr 27 10:12:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:29 devstack sudo[88351]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-89f07a93-f53b-4f28-803c-e1c8676c3646" returned: 0 in 5.208s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:29 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3d953e-8950-4151-b19a-76c9b793bb3d]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:30 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272 Apr 27 10:12:30 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:30 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272" returned: 0 in 0.665s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:30 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Image conversion details: src /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272, size 1024.00 MB, duration 5.21 sec, destination /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-89f07a93-f53b-4f28-803c-e1c8676c3646 {{(pid=81350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 10:12:30 devstack cinder-volume[81350]: INFO cinder.image.image_utils [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Converted 1024.00 MB image at 196.57 MB/s Apr 27 10:12:30 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-89f07a93-f53b-4f28-803c-e1c8676c3646 is being set with open permissions: ugo+rw Apr 27 10:12:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-89f07a93-f53b-4f28-803c-e1c8676c3646 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:30 devstack sudo[88385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-89f07a93-f53b-4f28-803c-e1c8676c3646 Apr 27 10:12:30 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:31 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-89f07a93-f53b-4f28-803c-e1c8676c3646" returned: 0 in 0.647s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-quobyte-89f07a93-f53b-4f28-803c-e1c8676c3646" released by "_copy_volume_from_snapshot" :: held 7.941s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-quobyte-27fa54e2-a096-42bf-85a1-ffe5b829c872-89f07a93-f53b-4f28-803c-e1c8676c3646" released by "_create_volume_from_snapshot" :: held 8.000s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.057s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.751s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:31 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=01d78bf3-cd7b-41c8-b519-cebf72db5934,created_at=2026-04-27T08:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-472053941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=01d78bf3-cd7b-41c8-b519-cebf72db5934,host='devstack@QuobyteHD#QuobyteHD',id=42985153-05bf-46f8-a2f9-fc7dfd152d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339a6b64c6b94ca98cef7fcca0a2f4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:12:26Z,use_quota=True,user_id='29c0afff810a4c0387dee9391a78ef21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b62fcf-0b24-4d74-80a3-323a46cf419c),volume_type_id=69b62fcf-0b24-4d74-80a3-323a46cf419c)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:12:31 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Creating volume 42985153-05bf-46f8-a2f9-fc7dfd152d92 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:12:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:31 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:12:31 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:12:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:31 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:12:31 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:12:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:31 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92 1073741824 Apr 27 10:12:31 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:31 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d18f9a16-8c49-43a7-aea9-bec5343284e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89f07a93-f53b-4f28-803c-e1c8676c3646', 'volume_size': 1, 'snapshot_id': '27fa54e2-a096-42bf-85a1-ffe5b829c872'}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:31 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb95b95-1d80-43fb-87a6-ca20e57b6345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:31 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Volume volume-89f07a93-f53b-4f28-803c-e1c8676c3646 (89f07a93-f53b-4f28-803c-e1c8676c3646): created successfully Apr 27 10:12:31 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb95b95-1d80-43fb-87a6-ca20e57b6345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:31 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Flow 'volume_create_manager' (13286be0-a09d-41bc-bdf6-ee0325853377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:12:31 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-7b63f609-9f1d-4973-893d-91e96e864095 tempest-VolumesDeleteCascade-1152200705 None] Created volume successfully. Apr 27 10:12:32 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92 1073741824" returned: 0 in 0.674s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:32 devstack sudo[88427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92 Apr 27 10:12:32 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "cinder-aed57463-c468-454a-bb9f-f90abb009272-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-aed57463-c468-454a-bb9f-f90abb009272-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Performing cascade delete. {{(pid=81350) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 27 10:12:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "cinder-27fa54e2-a096-42bf-85a1-ffe5b829c872-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-27fa54e2-a096-42bf-85a1-ffe5b829c872-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "cinder-quobyte-aed57463-c468-454a-bb9f-f90abb009272" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-quobyte-aed57463-c468-454a-bb9f-f90abb009272" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "cinder-quobyte-27fa54e2-a096-42bf-85a1-ffe5b829c872" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-quobyte-27fa54e2-a096-42bf-85a1-ffe5b829c872" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Deleting offline snapshot 27fa54e2-a096-42bf-85a1-ffe5b829c872 of volume aed57463-c468-454a-bb9f-f90abb009272 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:12:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] snapshot_file for this snap is: volume-aed57463-c468-454a-bb9f-f90abb009272.27fa54e2-a096-42bf-85a1-ffe5b829c872 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:12:32 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2ec030-f0f4-451d-9c07-69b82e53735f]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.27fa54e2-a096-42bf-85a1-ffe5b829c872 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:32 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.27fa54e2-a096-42bf-85a1-ffe5b829c872 Apr 27 10:12:32 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:32 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92" returned: 0 in 0.492s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:12:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f438d75-e489-4923-b391-0d13ef8191cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42985153-05bf-46f8-a2f9-fc7dfd152d92', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fafec920-c9dc-47fc-8dfa-61f212ccad32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:32 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Volume volume-42985153-05bf-46f8-a2f9-fc7dfd152d92 (42985153-05bf-46f8-a2f9-fc7dfd152d92): created successfully Apr 27 10:12:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fafec920-c9dc-47fc-8dfa-61f212ccad32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Flow 'volume_create_manager' (d59cc3d0-332a-40ef-8e6d-52e6245555e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:12:32 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-52220993-790b-4873-99bd-877cd9ac8d27 tempest-GroupSnapshotsTest-2035960321 None] Created volume successfully. Apr 27 10:12:33 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.27fa54e2-a096-42bf-85a1-ffe5b829c872" returned: 0 in 0.641s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:33 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aed57463-c468-454a-bb9f-f90abb009272(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:12:33 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd0e599-2ab0-47b0-9c4e-d5b36f95d10a]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:33 devstack sudo[88435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272 Apr 27 10:12:33 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:33 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-e240a1e6-f569-45c9-981c-22da3d2bec23 tempest-GroupSnapshotsTest-2035960321 None] GroupSnapshot ba7acfa7-0f31-4dd6-a0f6-6ed02a9e3133: creating. Apr 27 10:12:33 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:SELECT=146,cinder:UPDATE=130,cinder:INSERT=34,cinder:DELETE=10 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:12:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e240a1e6-f569-45c9-981c-22da3d2bec23 tempest-GroupSnapshotsTest-2035960321 None] Group snapshot ba7acfa7-0f31-4dd6-a0f6-6ed02a9e3133: creating. {{(pid=81350) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 27 10:12:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e240a1e6-f569-45c9-981c-22da3d2bec23 tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e240a1e6-f569-45c9-981c-22da3d2bec23 tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:33 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-e240a1e6-f569-45c9-981c-22da3d2bec23 tempest-GroupSnapshotsTest-2035960321 None] Creating offline snapshot 4c0d97c0-8981-4743-9628-3dccdac16f82 of volume 42985153-05bf-46f8-a2f9-fc7dfd152d92 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:12:33 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68d61e5-8fca-41ea-90d7-62eb903f0bfc]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e240a1e6-f569-45c9-981c-22da3d2bec23 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:33 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92 Apr 27 10:12:33 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:34 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272" returned: 0 in 0.988s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.27fa54e2-a096-42bf-85a1-ffe5b829c872 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:34 devstack sudo[88446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.27fa54e2-a096-42bf-85a1-ffe5b829c872 Apr 27 10:12:34 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:34 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e240a1e6-f569-45c9-981c-22da3d2bec23 tempest-GroupSnapshotsTest-2035960321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92" returned: 0 in 0.678s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e240a1e6-f569-45c9-981c-22da3d2bec23 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.4c0d97c0-8981-4743-9628-3dccdac16f82 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:34 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.4c0d97c0-8981-4743-9628-3dccdac16f82 1G Apr 27 10:12:34 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:34 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.27fa54e2-a096-42bf-85a1-ffe5b829c872" returned: 0 in 0.607s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.27fa54e2-a096-42bf-85a1-ffe5b829c872 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:34 devstack sudo[88457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.27fa54e2-a096-42bf-85a1-ffe5b829c872 Apr 27 10:12:34 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:34 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e240a1e6-f569-45c9-981c-22da3d2bec23 tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.4c0d97c0-8981-4743-9628-3dccdac16f82 1G" returned: 0 in 0.645s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e240a1e6-f569-45c9-981c-22da3d2bec23 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42985153-05bf-46f8-a2f9-fc7dfd152d92 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.4c0d97c0-8981-4743-9628-3dccdac16f82 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:34 devstack sudo[88464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42985153-05bf-46f8-a2f9-fc7dfd152d92 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.4c0d97c0-8981-4743-9628-3dccdac16f82 Apr 27 10:12:34 devstack sudo[88464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:35 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272.27fa54e2-a096-42bf-85a1-ffe5b829c872" returned: 0 in 0.684s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-quobyte-27fa54e2-a096-42bf-85a1-ffe5b829c872" released by "_delete_snapshot" :: held 3.052s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-quobyte-aed57463-c468-454a-bb9f-f90abb009272" released by "delete_snapshot" :: held 3.076s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:35 devstack sudo[88464]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e240a1e6-f569-45c9-981c-22da3d2bec23 tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42985153-05bf-46f8-a2f9-fc7dfd152d92 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.4c0d97c0-8981-4743-9628-3dccdac16f82" returned: 0 in 0.637s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:35 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-e240a1e6-f569-45c9-981c-22da3d2bec23 tempest-GroupSnapshotsTest-2035960321 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.4c0d97c0-8981-4743-9628-3dccdac16f82 is being set with open permissions: ugo+rw: NotImplementedError Apr 27 10:12:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e240a1e6-f569-45c9-981c-22da3d2bec23 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.4c0d97c0-8981-4743-9628-3dccdac16f82 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:35 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.4c0d97c0-8981-4743-9628-3dccdac16f82 Apr 27 10:12:35 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:35 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Created reservations ['39845e28-9ee6-4ef8-898a-8d420e118110', '8aa16184-2b8e-48c5-99bf-78b361f8ec6b', '95391539-f64c-4537-9a8e-a26e845375f9', '31efa241-822c-4631-af8c-b4cf15518d77'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:12:35 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Delete snapshot completed successfully. Apr 27 10:12:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-27fa54e2-a096-42bf-85a1-ffe5b829c872-delete_snapshot" released by "delete_snapshot" :: held 3.287s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Snapshots deleted, issuing volume delete {{(pid=81350) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 27 10:12:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "cinder-quobyte-aed57463-c468-454a-bb9f-f90abb009272" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-quobyte-aed57463-c468-454a-bb9f-f90abb009272" acquired by "delete_volume" :: waited 0.013s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:35 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1f0e26-c4f8-48ad-a647-ee488e2e4ad8]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:35 devstack sudo[88492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272 Apr 27 10:12:35 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:35 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e240a1e6-f569-45c9-981c-22da3d2bec23 tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.4c0d97c0-8981-4743-9628-3dccdac16f82" returned: 0 in 0.524s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e240a1e6-f569-45c9-981c-22da3d2bec23 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:36 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.info Apr 27 10:12:36 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:36 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272" returned: 0 in 0.559s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:36 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272 Apr 27 10:12:36 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:36 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e240a1e6-f569-45c9-981c-22da3d2bec23 tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.info" returned: 0 in 0.496s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:36 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-e240a1e6-f569-45c9-981c-22da3d2bec23 tempest-GroupSnapshotsTest-2035960321 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.info is being set with open permissions: ugo+rw: NotImplementedError Apr 27 10:12:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e240a1e6-f569-45c9-981c-22da3d2bec23 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:36 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.info Apr 27 10:12:36 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:36 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-aed57463-c468-454a-bb9f-f90abb009272" returned: 0 in 0.487s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-quobyte-aed57463-c468-454a-bb9f-f90abb009272" released by "delete_volume" :: held 1.130s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:36 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Created reservations ['b36d4220-b22b-4de0-b476-84984769e690', 'e46cd436-d1ed-43b8-9442-e749e5be4585', '4bf7d60a-742c-4ef8-9e0b-ee0820321469', 'b166e000-49de-43a6-a255-8e9653e2ce62'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:12:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:12:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:12:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:36 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:12:36 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:37 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e240a1e6-f569-45c9-981c-22da3d2bec23 tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.info" returned: 0 in 0.562s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e240a1e6-f569-45c9-981c-22da3d2bec23 tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.638s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:37 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-e240a1e6-f569-45c9-981c-22da3d2bec23 tempest-GroupSnapshotsTest-2035960321 None] group_snapshot ba7acfa7-0f31-4dd6-a0f6-6ed02a9e3133: created successfully Apr 27 10:12:37 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.464s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:37 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:12:37 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Deleted volume successfully. Apr 27 10:12:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fe2207e1-1e06-4b05-9e54-7198cfa5ba3e tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-aed57463-c468-454a-bb9f-f90abb009272-delete_volume" released by "delete_volume" :: held 5.179s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:37 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-9c0fe618-24a5-4177-a40c-a882ac4533ff tempest-GroupSnapshotsTest-2035960321 None] group_snapshot ba7acfa7-0f31-4dd6-a0f6-6ed02a9e3133: deleting Apr 27 10:12:37 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-9c0fe618-24a5-4177-a40c-a882ac4533ff tempest-GroupSnapshotsTest-2035960321 None] group_snapshot ba7acfa7-0f31-4dd6-a0f6-6ed02a9e3133: deleting {{(pid=81350) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 27 10:12:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9c0fe618-24a5-4177-a40c-a882ac4533ff tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "cinder-quobyte-42985153-05bf-46f8-a2f9-fc7dfd152d92" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9c0fe618-24a5-4177-a40c-a882ac4533ff tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-42985153-05bf-46f8-a2f9-fc7dfd152d92" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9c0fe618-24a5-4177-a40c-a882ac4533ff tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "cinder-quobyte-4c0d97c0-8981-4743-9628-3dccdac16f82" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9d3a017f-86ca-4f55-b349-e4b2ed9b0eb8 tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "cinder-89f07a93-f53b-4f28-803c-e1c8676c3646-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9c0fe618-24a5-4177-a40c-a882ac4533ff tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-4c0d97c0-8981-4743-9628-3dccdac16f82" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:37 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-9c0fe618-24a5-4177-a40c-a882ac4533ff tempest-GroupSnapshotsTest-2035960321 None] Deleting offline snapshot 4c0d97c0-8981-4743-9628-3dccdac16f82 of volume 42985153-05bf-46f8-a2f9-fc7dfd152d92 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:12:37 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-9c0fe618-24a5-4177-a40c-a882ac4533ff tempest-GroupSnapshotsTest-2035960321 None] snapshot_file for this snap is: volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.4c0d97c0-8981-4743-9628-3dccdac16f82 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:12:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9d3a017f-86ca-4f55-b349-e4b2ed9b0eb8 tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-89f07a93-f53b-4f28-803c-e1c8676c3646-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:37 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f0d849-e308-463c-8004-e617af8f45fc]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9c0fe618-24a5-4177-a40c-a882ac4533ff tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.4c0d97c0-8981-4743-9628-3dccdac16f82 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9d3a017f-86ca-4f55-b349-e4b2ed9b0eb8 tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "cinder-quobyte-89f07a93-f53b-4f28-803c-e1c8676c3646" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9d3a017f-86ca-4f55-b349-e4b2ed9b0eb8 tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-quobyte-89f07a93-f53b-4f28-803c-e1c8676c3646" acquired by "delete_volume" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:38 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f841acc-e2e5-46f9-a6c4-1ed736968796]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9d3a017f-86ca-4f55-b349-e4b2ed9b0eb8 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-89f07a93-f53b-4f28-803c-e1c8676c3646 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:38 devstack sudo[88512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.4c0d97c0-8981-4743-9628-3dccdac16f82 Apr 27 10:12:38 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:38 devstack sudo[88513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-89f07a93-f53b-4f28-803c-e1c8676c3646 Apr 27 10:12:38 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:38 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9c0fe618-24a5-4177-a40c-a882ac4533ff tempest-GroupSnapshotsTest-2035960321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.4c0d97c0-8981-4743-9628-3dccdac16f82" returned: 0 in 0.579s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:38 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-9c0fe618-24a5-4177-a40c-a882ac4533ff tempest-GroupSnapshotsTest-2035960321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42985153-05bf-46f8-a2f9-fc7dfd152d92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:12:38 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd530c6-f625-43e6-a994-121bb15a0afe]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9c0fe618-24a5-4177-a40c-a882ac4533ff tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:38 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9d3a017f-86ca-4f55-b349-e4b2ed9b0eb8 tempest-VolumesDeleteCascade-1152200705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-89f07a93-f53b-4f28-803c-e1c8676c3646" returned: 0 in 0.560s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9d3a017f-86ca-4f55-b349-e4b2ed9b0eb8 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-89f07a93-f53b-4f28-803c-e1c8676c3646 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:38 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-89f07a93-f53b-4f28-803c-e1c8676c3646 Apr 27 10:12:38 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:38 devstack sudo[88522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92 Apr 27 10:12:38 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:39 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9d3a017f-86ca-4f55-b349-e4b2ed9b0eb8 tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-89f07a93-f53b-4f28-803c-e1c8676c3646" returned: 0 in 0.458s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9d3a017f-86ca-4f55-b349-e4b2ed9b0eb8 tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-quobyte-89f07a93-f53b-4f28-803c-e1c8676c3646" released by "delete_volume" :: held 1.074s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:39 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9c0fe618-24a5-4177-a40c-a882ac4533ff tempest-GroupSnapshotsTest-2035960321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92" returned: 0 in 0.542s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9c0fe618-24a5-4177-a40c-a882ac4533ff tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.4c0d97c0-8981-4743-9628-3dccdac16f82 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:39 devstack sudo[88530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.4c0d97c0-8981-4743-9628-3dccdac16f82 Apr 27 10:12:39 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:39 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-9d3a017f-86ca-4f55-b349-e4b2ed9b0eb8 tempest-VolumesDeleteCascade-1152200705 None] Created reservations ['626d5137-63ef-48ed-baf6-0b64c9bc76e6', 'a0def201-40c2-4d68-8df8-f99cb08b21ef', '985f5f77-1551-4f5e-9ac2-c8b84e2282bb', '75379fbf-9d5b-499f-901a-0120bae89eae'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:12:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-9d3a017f-86ca-4f55-b349-e4b2ed9b0eb8 tempest-VolumesDeleteCascade-1152200705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-9d3a017f-86ca-4f55-b349-e4b2ed9b0eb8 tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:39 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-9d3a017f-86ca-4f55-b349-e4b2ed9b0eb8 tempest-VolumesDeleteCascade-1152200705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:12:39 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-9d3a017f-86ca-4f55-b349-e4b2ed9b0eb8 tempest-VolumesDeleteCascade-1152200705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:12:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-9d3a017f-86ca-4f55-b349-e4b2ed9b0eb8 tempest-VolumesDeleteCascade-1152200705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9d3a017f-86ca-4f55-b349-e4b2ed9b0eb8 tempest-VolumesDeleteCascade-1152200705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:39 devstack sudo[88532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:12:39 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:39 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9c0fe618-24a5-4177-a40c-a882ac4533ff tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.4c0d97c0-8981-4743-9628-3dccdac16f82" returned: 0 in 0.566s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9c0fe618-24a5-4177-a40c-a882ac4533ff tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.4c0d97c0-8981-4743-9628-3dccdac16f82 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:39 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.4c0d97c0-8981-4743-9628-3dccdac16f82 Apr 27 10:12:39 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:39 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9d3a017f-86ca-4f55-b349-e4b2ed9b0eb8 tempest-VolumesDeleteCascade-1152200705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.491s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:39 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-9d3a017f-86ca-4f55-b349-e4b2ed9b0eb8 tempest-VolumesDeleteCascade-1152200705 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:12:39 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-9d3a017f-86ca-4f55-b349-e4b2ed9b0eb8 tempest-VolumesDeleteCascade-1152200705 None] Deleted volume successfully. Apr 27 10:12:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9d3a017f-86ca-4f55-b349-e4b2ed9b0eb8 tempest-VolumesDeleteCascade-1152200705 None] Lock "cinder-89f07a93-f53b-4f28-803c-e1c8676c3646-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:40 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9c0fe618-24a5-4177-a40c-a882ac4533ff tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92.4c0d97c0-8981-4743-9628-3dccdac16f82" returned: 0 in 0.464s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:40 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9c0fe618-24a5-4177-a40c-a882ac4533ff tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-4c0d97c0-8981-4743-9628-3dccdac16f82" released by "_delete_snapshot" :: held 2.273s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:40 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-9c0fe618-24a5-4177-a40c-a882ac4533ff tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-42985153-05bf-46f8-a2f9-fc7dfd152d92" released by "delete_snapshot" :: held 2.323s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:40 devstack cinder-volume[81350]: WARNING cinder.quota [None req-9c0fe618-24a5-4177-a40c-a882ac4533ff tempest-GroupSnapshotsTest-2035960321 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2134063291 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2134063291, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:12:40 devstack cinder-volume[81350]: WARNING cinder.quota [None req-9c0fe618-24a5-4177-a40c-a882ac4533ff tempest-GroupSnapshotsTest-2035960321 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2134063291 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2134063291, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:12:40 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-9c0fe618-24a5-4177-a40c-a882ac4533ff tempest-GroupSnapshotsTest-2035960321 None] Created reservations ['091d3844-c31e-4812-94ef-b9aae85ea9a3', '1dddd909-0ff7-4f64-90e0-ebf499959215', '35bd49df-04b0-4441-95eb-4b0b60ba7a50', '9092989f-d31c-4412-bb7f-e65623b48f59'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:12:40 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-9c0fe618-24a5-4177-a40c-a882ac4533ff tempest-GroupSnapshotsTest-2035960321 None] group_snapshot ba7acfa7-0f31-4dd6-a0f6-6ed02a9e3133: deleted successfully Apr 27 10:12:41 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7b156fd3-9fd4-47f5-82c0-9457ddb23bf7 tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "cinder-quobyte-42985153-05bf-46f8-a2f9-fc7dfd152d92" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:41 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7b156fd3-9fd4-47f5-82c0-9457ddb23bf7 tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-42985153-05bf-46f8-a2f9-fc7dfd152d92" acquired by "delete_volume" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:41 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ec4c0b-3042-4565-83f7-7dd70a3bc7ad]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7b156fd3-9fd4-47f5-82c0-9457ddb23bf7 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:41 devstack sudo[88541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92 Apr 27 10:12:41 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:42 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7b156fd3-9fd4-47f5-82c0-9457ddb23bf7 tempest-GroupSnapshotsTest-2035960321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92" returned: 0 in 0.611s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7b156fd3-9fd4-47f5-82c0-9457ddb23bf7 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:42 devstack sudo[88546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92 Apr 27 10:12:42 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:42 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7b156fd3-9fd4-47f5-82c0-9457ddb23bf7 tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-42985153-05bf-46f8-a2f9-fc7dfd152d92" returned: 0 in 0.576s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:42 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7b156fd3-9fd4-47f5-82c0-9457ddb23bf7 tempest-GroupSnapshotsTest-2035960321 None] Lock "cinder-quobyte-42985153-05bf-46f8-a2f9-fc7dfd152d92" released by "delete_volume" :: held 1.300s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:42 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:UPDATE=192,cinder:SELECT=166,cinder:INSERT=52,cinder:DELETE=8 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:12:42 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-7b156fd3-9fd4-47f5-82c0-9457ddb23bf7 tempest-GroupSnapshotsTest-2035960321 None] Created reservations ['9e2d2519-9ca6-4d01-9074-90289401f988'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:12:42 devstack cinder-volume[81350]: WARNING cinder.quota [None req-7b156fd3-9fd4-47f5-82c0-9457ddb23bf7 tempest-GroupSnapshotsTest-2035960321 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2134063291 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2134063291, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:12:42 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-7b156fd3-9fd4-47f5-82c0-9457ddb23bf7 tempest-GroupSnapshotsTest-2035960321 None] Created reservations ['f50c0f36-58e3-4392-8be1-69a37689fd31', 'f2190f72-bdd6-4e92-92dd-f2152dcb25ac', 'bed002d5-8454-410f-8ef8-e2bbc6975ac5', 'dcef13ef-a318-4dee-be58-9c1edfe6e74c'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:12:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7b156fd3-9fd4-47f5-82c0-9457ddb23bf7 tempest-GroupSnapshotsTest-2035960321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7b156fd3-9fd4-47f5-82c0-9457ddb23bf7 tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:42 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7b156fd3-9fd4-47f5-82c0-9457ddb23bf7 tempest-GroupSnapshotsTest-2035960321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:12:42 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7b156fd3-9fd4-47f5-82c0-9457ddb23bf7 tempest-GroupSnapshotsTest-2035960321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:12:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7b156fd3-9fd4-47f5-82c0-9457ddb23bf7 tempest-GroupSnapshotsTest-2035960321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7b156fd3-9fd4-47f5-82c0-9457ddb23bf7 tempest-GroupSnapshotsTest-2035960321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:42 devstack sudo[88550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:12:42 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:43 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7b156fd3-9fd4-47f5-82c0-9457ddb23bf7 tempest-GroupSnapshotsTest-2035960321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.529s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:43 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-7b156fd3-9fd4-47f5-82c0-9457ddb23bf7 tempest-GroupSnapshotsTest-2035960321 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:12:43 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-7b156fd3-9fd4-47f5-82c0-9457ddb23bf7 tempest-GroupSnapshotsTest-2035960321 None] Delete group completed successfully. Apr 27 10:12:44 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:12:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Flow 'volume_create_manager' (da0f6586-37e1-4cd2-bbc4-3c8e3ee5a109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:12:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb3ce8c6-85a9-4f1c-a171-531c316c5a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb3ce8c6-85a9-4f1c-a171-531c316c5a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1474897649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=422adb33-21c0-4607-b835-85ac0fbcb600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6bb8b0a15fe4400aa95693234f7709e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:12:44Z,use_quota=True,user_id='83eecf88e3c245a894b67301af53284b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (440168ab-306a-4155-be50-f45e1ee425ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (440168ab-306a-4155-be50-f45e1ee425ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3246f7a8-527d-4c8b-b037-b327c78026d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3246f7a8-527d-4c8b-b037-b327c78026d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '422adb33-21c0-4607-b835-85ac0fbcb600', 'volume_name': 'volume-422adb33-21c0-4607-b835-85ac0fbcb600', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa4a3dfa-b3e3-49c6-a8de-f359911f03c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa4a3dfa-b3e3-49c6-a8de-f359911f03c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7580c86f-5578-4e7a-a59d-c2f0c23cc919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:44 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Volume 422adb33-21c0-4607-b835-85ac0fbcb600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-422adb33-21c0-4607-b835-85ac0fbcb600', 'volume_size': 1} Apr 27 10:12:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:44 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1474897649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=422adb33-21c0-4607-b835-85ac0fbcb600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6bb8b0a15fe4400aa95693234f7709e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:12:44Z,use_quota=True,user_id='83eecf88e3c245a894b67301af53284b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:12:44 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Creating volume 422adb33-21c0-4607-b835-85ac0fbcb600 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:12:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:44 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:12:44 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:12:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:44 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:12:44 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:12:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-422adb33-21c0-4607-b835-85ac0fbcb600 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:44 devstack sudo[88555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-422adb33-21c0-4607-b835-85ac0fbcb600 1073741824 Apr 27 10:12:44 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:45 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-422adb33-21c0-4607-b835-85ac0fbcb600 1073741824" returned: 0 in 0.768s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-422adb33-21c0-4607-b835-85ac0fbcb600 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:45 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-422adb33-21c0-4607-b835-85ac0fbcb600 Apr 27 10:12:45 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:45 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-422adb33-21c0-4607-b835-85ac0fbcb600" returned: 0 in 0.614s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:45 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:12:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:45 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7580c86f-5578-4e7a-a59d-c2f0c23cc919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-422adb33-21c0-4607-b835-85ac0fbcb600', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:45 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (020cec7f-1d50-49cb-be17-41478e3d2b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:45 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Volume volume-422adb33-21c0-4607-b835-85ac0fbcb600 (422adb33-21c0-4607-b835-85ac0fbcb600): created successfully Apr 27 10:12:45 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (020cec7f-1d50-49cb-be17-41478e3d2b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:45 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Flow 'volume_create_manager' (da0f6586-37e1-4cd2-bbc4-3c8e3ee5a109) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:12:45 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-d877e7e2-0123-480e-8fcc-b3f9b9600787 tempest-VolumesTransfersV355Test-10647819 None] Created volume successfully. Apr 27 10:12:47 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-73c7f10d-a898-41b9-aa63-352925b68913 tempest-VolumesTransfersV355Test-2069962469 None] Transfer volume completed successfully. Apr 27 10:12:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-212d21db-47dd-45e8-981c-fc8a073d7fdb tempest-VolumesNegativeTest-1388619715 None] Acquiring lock "cinder-9c7847c9-4330-4af6-8de7-894fc4edbeea-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-212d21db-47dd-45e8-981c-fc8a073d7fdb tempest-VolumesNegativeTest-1388619715 None] Lock "cinder-9c7847c9-4330-4af6-8de7-894fc4edbeea-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-212d21db-47dd-45e8-981c-fc8a073d7fdb tempest-VolumesNegativeTest-1388619715 None] Acquiring lock "cinder-quobyte-9c7847c9-4330-4af6-8de7-894fc4edbeea" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-212d21db-47dd-45e8-981c-fc8a073d7fdb tempest-VolumesNegativeTest-1388619715 None] Lock "cinder-quobyte-9c7847c9-4330-4af6-8de7-894fc4edbeea" acquired by "delete_volume" :: waited 0.014s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:47 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[71304e93-f57d-485c-9c29-61c47a5ce26e]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-212d21db-47dd-45e8-981c-fc8a073d7fdb tempest-VolumesNegativeTest-1388619715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9c7847c9-4330-4af6-8de7-894fc4edbeea {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:47 devstack sudo[88564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9c7847c9-4330-4af6-8de7-894fc4edbeea Apr 27 10:12:47 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:47 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-212d21db-47dd-45e8-981c-fc8a073d7fdb tempest-VolumesNegativeTest-1388619715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9c7847c9-4330-4af6-8de7-894fc4edbeea" returned: 0 in 0.620s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-212d21db-47dd-45e8-981c-fc8a073d7fdb tempest-VolumesNegativeTest-1388619715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9c7847c9-4330-4af6-8de7-894fc4edbeea {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:48 devstack sudo[88569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9c7847c9-4330-4af6-8de7-894fc4edbeea Apr 27 10:12:48 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5d572961-ad39-4136-a94e-49ff3c92df64 tempest-VolumesTransfersV355Test-733113559 None] Acquiring lock "cinder-422adb33-21c0-4607-b835-85ac0fbcb600-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5d572961-ad39-4136-a94e-49ff3c92df64 tempest-VolumesTransfersV355Test-733113559 None] Lock "cinder-422adb33-21c0-4607-b835-85ac0fbcb600-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5d572961-ad39-4136-a94e-49ff3c92df64 tempest-VolumesTransfersV355Test-733113559 None] Acquiring lock "cinder-quobyte-422adb33-21c0-4607-b835-85ac0fbcb600" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5d572961-ad39-4136-a94e-49ff3c92df64 tempest-VolumesTransfersV355Test-733113559 None] Lock "cinder-quobyte-422adb33-21c0-4607-b835-85ac0fbcb600" acquired by "delete_volume" :: waited 0.031s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:48 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c4ca2a-1cfa-4cf9-bcb1-3c87b8ddb4ee]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5d572961-ad39-4136-a94e-49ff3c92df64 tempest-VolumesTransfersV355Test-733113559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-422adb33-21c0-4607-b835-85ac0fbcb600 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:48 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-212d21db-47dd-45e8-981c-fc8a073d7fdb tempest-VolumesNegativeTest-1388619715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9c7847c9-4330-4af6-8de7-894fc4edbeea" returned: 0 in 0.514s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-212d21db-47dd-45e8-981c-fc8a073d7fdb tempest-VolumesNegativeTest-1388619715 None] Lock "cinder-quobyte-9c7847c9-4330-4af6-8de7-894fc4edbeea" released by "delete_volume" :: held 1.184s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:48 devstack sudo[88572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-422adb33-21c0-4607-b835-85ac0fbcb600 Apr 27 10:12:48 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:48 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-212d21db-47dd-45e8-981c-fc8a073d7fdb tempest-VolumesNegativeTest-1388619715 None] Created reservations ['2480ad82-2de4-4639-8bdf-464b8607ee31', '0eb86ad3-fa1d-46aa-8976-d9322168e215', '0959d3da-6670-41ae-bfad-4e31fe724d4e', 'fd1f5526-af7a-402a-8093-14347097ba08'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:12:48 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-486661a4-ecb5-42bf-bf51-741d2f9e7296 tempest-GroupsTest-1457143907 None] Group tempest-Group1-1037279967: creating Apr 27 10:12:48 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-486661a4-ecb5-42bf-bf51-741d2f9e7296 tempest-GroupsTest-1457143907 None] Group tempest-Group1-1037279967: created successfully Apr 27 10:12:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-212d21db-47dd-45e8-981c-fc8a073d7fdb tempest-VolumesNegativeTest-1388619715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-212d21db-47dd-45e8-981c-fc8a073d7fdb tempest-VolumesNegativeTest-1388619715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-212d21db-47dd-45e8-981c-fc8a073d7fdb tempest-VolumesNegativeTest-1388619715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:12:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-212d21db-47dd-45e8-981c-fc8a073d7fdb tempest-VolumesNegativeTest-1388619715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:12:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-212d21db-47dd-45e8-981c-fc8a073d7fdb tempest-VolumesNegativeTest-1388619715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-212d21db-47dd-45e8-981c-fc8a073d7fdb tempest-VolumesNegativeTest-1388619715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:48 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-486661a4-ecb5-42bf-bf51-741d2f9e7296 tempest-GroupsTest-1457143907 None] Create group completed successfully. Apr 27 10:12:48 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:12:48 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:49 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5d572961-ad39-4136-a94e-49ff3c92df64 tempest-VolumesTransfersV355Test-733113559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-422adb33-21c0-4607-b835-85ac0fbcb600" returned: 0 in 0.578s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5d572961-ad39-4136-a94e-49ff3c92df64 tempest-VolumesTransfersV355Test-733113559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-422adb33-21c0-4607-b835-85ac0fbcb600 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:49 devstack sudo[88580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-422adb33-21c0-4607-b835-85ac0fbcb600 Apr 27 10:12:49 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:49 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-212d21db-47dd-45e8-981c-fc8a073d7fdb tempest-VolumesNegativeTest-1388619715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.442s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:49 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-212d21db-47dd-45e8-981c-fc8a073d7fdb tempest-VolumesNegativeTest-1388619715 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:12:49 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-212d21db-47dd-45e8-981c-fc8a073d7fdb tempest-VolumesNegativeTest-1388619715 None] Deleted volume successfully. Apr 27 10:12:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-212d21db-47dd-45e8-981c-fc8a073d7fdb tempest-VolumesNegativeTest-1388619715 None] Lock "cinder-9c7847c9-4330-4af6-8de7-894fc4edbeea-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:49 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5d572961-ad39-4136-a94e-49ff3c92df64 tempest-VolumesTransfersV355Test-733113559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-422adb33-21c0-4607-b835-85ac0fbcb600" returned: 0 in 0.486s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5d572961-ad39-4136-a94e-49ff3c92df64 tempest-VolumesTransfersV355Test-733113559 None] Lock "cinder-quobyte-422adb33-21c0-4607-b835-85ac0fbcb600" released by "delete_volume" :: held 1.108s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:49 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-5d572961-ad39-4136-a94e-49ff3c92df64 tempest-VolumesTransfersV355Test-733113559 None] Created reservations ['240b553a-fc4a-4662-ab94-651c1bd837da', '405d59a1-e11f-4ee9-8ea9-b15bba689c42', '42b47b7a-a133-4127-ae52-3c7c78fc4696', '2acf4f5f-8dfa-4d4f-bc5c-6c31ebd46149'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:12:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5d572961-ad39-4136-a94e-49ff3c92df64 tempest-VolumesTransfersV355Test-733113559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5d572961-ad39-4136-a94e-49ff3c92df64 tempest-VolumesTransfersV355Test-733113559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:49 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5d572961-ad39-4136-a94e-49ff3c92df64 tempest-VolumesTransfersV355Test-733113559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:12:49 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5d572961-ad39-4136-a94e-49ff3c92df64 tempest-VolumesTransfersV355Test-733113559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:12:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5d572961-ad39-4136-a94e-49ff3c92df64 tempest-VolumesTransfersV355Test-733113559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5d572961-ad39-4136-a94e-49ff3c92df64 tempest-VolumesTransfersV355Test-733113559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:49 devstack sudo[88583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:12:49 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:49 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-515b3ae0-4e89-4595-995c-2b844630b84a tempest-GroupsTest-1457143907 None] Group tempest-Group2-353133253: creating Apr 27 10:12:49 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-515b3ae0-4e89-4595-995c-2b844630b84a tempest-GroupsTest-1457143907 None] Group tempest-Group2-353133253: created successfully Apr 27 10:12:49 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-515b3ae0-4e89-4595-995c-2b844630b84a tempest-GroupsTest-1457143907 None] Create group completed successfully. Apr 27 10:12:50 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5d572961-ad39-4136-a94e-49ff3c92df64 tempest-VolumesTransfersV355Test-733113559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.528s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:50 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-5d572961-ad39-4136-a94e-49ff3c92df64 tempest-VolumesTransfersV355Test-733113559 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:12:50 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-5d572961-ad39-4136-a94e-49ff3c92df64 tempest-VolumesTransfersV355Test-733113559 None] Deleted volume successfully. Apr 27 10:12:50 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5d572961-ad39-4136-a94e-49ff3c92df64 tempest-VolumesTransfersV355Test-733113559 None] Lock "cinder-422adb33-21c0-4607-b835-85ac0fbcb600-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:50 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Flow 'volume_create_manager' (6dbf33b7-f076-4a48-967a-e5af1411d18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53fc6d7e-f060-4cb0-93aa-7ba0f18575f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53fc6d7e-f060-4cb0-93aa-7ba0f18575f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-492074146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9417f279-88e6-4abd-92fd-9f582a97d25b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6bb8b0a15fe4400aa95693234f7709e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:12:51Z,use_quota=True,user_id='83eecf88e3c245a894b67301af53284b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6227b7e3-876b-4e14-9018-f753ade66ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6227b7e3-876b-4e14-9018-f753ade66ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1097d44a-ee18-451f-91d1-2827dd08cd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1097d44a-ee18-451f-91d1-2827dd08cd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9417f279-88e6-4abd-92fd-9f582a97d25b', 'volume_name': 'volume-9417f279-88e6-4abd-92fd-9f582a97d25b', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88e1d2f-284b-44ac-91b7-3d0a21077615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88e1d2f-284b-44ac-91b7-3d0a21077615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb223c9-9125-4c8c-929b-3eef87d7b270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:51 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Volume 9417f279-88e6-4abd-92fd-9f582a97d25b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9417f279-88e6-4abd-92fd-9f582a97d25b', 'volume_size': 1} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-492074146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9417f279-88e6-4abd-92fd-9f582a97d25b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6bb8b0a15fe4400aa95693234f7709e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:12:51Z,use_quota=True,user_id='83eecf88e3c245a894b67301af53284b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Creating volume 9417f279-88e6-4abd-92fd-9f582a97d25b {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:12:51 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9417f279-88e6-4abd-92fd-9f582a97d25b 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:51 devstack sudo[88586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9417f279-88e6-4abd-92fd-9f582a97d25b 1073741824 Apr 27 10:12:51 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Flow 'volume_create_manager' (69d41f09-2c34-4c85-bb3e-d21d2795f590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e157694d-f527-430e-a5bc-0908b9729f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e157694d-f527-430e-a5bc-0908b9729f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-432499566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8d35026-501b-4ec6-a7b3-f5a16e76bc88,host='devstack@QuobyteHD#QuobyteHD',id=b336d03c-fb58-4e5d-84e5-98f89367a52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88385a2d73054b88ac393cd16cbcc31c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:12:51Z,use_quota=True,user_id='56e1e6b5dc54460e90f9d86b8f7e0d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebed5f7f-f9fc-4f42-a318-410b42f7f922),volume_type_id=ebed5f7f-f9fc-4f42-a318-410b42f7f922)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0709dc58-bd6d-4709-bb14-7ea18dbc56c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0709dc58-bd6d-4709-bb14-7ea18dbc56c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1217e2d-9296-4270-a24e-7516439cbb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1217e2d-9296-4270-a24e-7516439cbb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b336d03c-fb58-4e5d-84e5-98f89367a52f', 'volume_name': 'volume-b336d03c-fb58-4e5d-84e5-98f89367a52f', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5d658f-8a6d-40e1-aeee-d1dea790a065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5d658f-8a6d-40e1-aeee-d1dea790a065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce60156e-857a-45f7-9699-9fa7f353ed64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:51 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Volume b336d03c-fb58-4e5d-84e5-98f89367a52f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b336d03c-fb58-4e5d-84e5-98f89367a52f', 'volume_size': 1} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:12:51 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Flow 'volume_create_manager' (424cfebe-5f55-4b64-8c35-c8b78aa19ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03fbc2a6-2fe1-478a-9f26-9c8cc99ac50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9417f279-88e6-4abd-92fd-9f582a97d25b 1073741824" returned: 0 in 0.784s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03fbc2a6-2fe1-478a-9f26-9c8cc99ac50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f101e48e-729a-49b1-9bcf-00469bfcbe77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f2446304b244b0b82a91d94eafd57eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:12:52Z,use_quota=True,user_id='ef2ea7e34e624b53897f65fabf3467d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57befa0c-7068-41fd-a77d-2ac03d5936be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57befa0c-7068-41fd-a77d-2ac03d5936be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb3fb4c-8f40-47da-95a8-169335b9a3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb3fb4c-8f40-47da-95a8-169335b9a3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f101e48e-729a-49b1-9bcf-00469bfcbe77', 'volume_name': 'volume-f101e48e-729a-49b1-9bcf-00469bfcbe77', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db6d7fe-8a15-4714-945f-5f43d1d5256b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db6d7fe-8a15-4714-945f-5f43d1d5256b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7fb3eb-8785-4112-8af0-8b9af816167d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:51 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Volume f101e48e-729a-49b1-9bcf-00469bfcbe77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f101e48e-729a-49b1-9bcf-00469bfcbe77', 'volume_size': 1} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9417f279-88e6-4abd-92fd-9f582a97d25b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:51 devstack sudo[88591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9417f279-88e6-4abd-92fd-9f582a97d25b Apr 27 10:12:51 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:52 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9417f279-88e6-4abd-92fd-9f582a97d25b" returned: 0 in 0.429s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:52 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:12:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.898s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:52 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a8d35026-501b-4ec6-a7b3-f5a16e76bc88,created_at=2026-04-27T08:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-432499566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8d35026-501b-4ec6-a7b3-f5a16e76bc88,host='devstack@QuobyteHD#QuobyteHD',id=b336d03c-fb58-4e5d-84e5-98f89367a52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88385a2d73054b88ac393cd16cbcc31c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:12:51Z,use_quota=True,user_id='56e1e6b5dc54460e90f9d86b8f7e0d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebed5f7f-f9fc-4f42-a318-410b42f7f922),volume_type_id=ebed5f7f-f9fc-4f42-a318-410b42f7f922)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:12:52 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Creating volume b336d03c-fb58-4e5d-84e5-98f89367a52f {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:12:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:52 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:12:52 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:12:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:52 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:12:52 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:12:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b336d03c-fb58-4e5d-84e5-98f89367a52f 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:52 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb223c9-9125-4c8c-929b-3eef87d7b270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9417f279-88e6-4abd-92fd-9f582a97d25b', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:52 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b336d03c-fb58-4e5d-84e5-98f89367a52f 1073741824 Apr 27 10:12:52 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:52 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5dda50e-9c12-4165-8199-8e2659205703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:52 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Volume volume-9417f279-88e6-4abd-92fd-9f582a97d25b (9417f279-88e6-4abd-92fd-9f582a97d25b): created successfully Apr 27 10:12:52 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5dda50e-9c12-4165-8199-8e2659205703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:52 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Flow 'volume_create_manager' (6dbf33b7-f076-4a48-967a-e5af1411d18d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:12:52 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-db8f8dee-8e76-4d3d-be50-1ffc263c14d1 tempest-VolumesTransfersV355Test-10647819 None] Created volume successfully. Apr 27 10:12:52 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b336d03c-fb58-4e5d-84e5-98f89367a52f 1073741824" returned: 0 in 0.617s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b336d03c-fb58-4e5d-84e5-98f89367a52f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:53 devstack sudo[88599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b336d03c-fb58-4e5d-84e5-98f89367a52f Apr 27 10:12:53 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:53 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8d37941a-e37c-40ec-94d4-f8e46d38d9d3 tempest-VolumesTransfersV355Test-733113559 None] Acquiring lock "cinder-9417f279-88e6-4abd-92fd-9f582a97d25b-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:53 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8d37941a-e37c-40ec-94d4-f8e46d38d9d3 tempest-VolumesTransfersV355Test-733113559 None] Lock "cinder-9417f279-88e6-4abd-92fd-9f582a97d25b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:53 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8d37941a-e37c-40ec-94d4-f8e46d38d9d3 tempest-VolumesTransfersV355Test-733113559 None] Acquiring lock "cinder-quobyte-9417f279-88e6-4abd-92fd-9f582a97d25b" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:53 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8d37941a-e37c-40ec-94d4-f8e46d38d9d3 tempest-VolumesTransfersV355Test-733113559 None] Lock "cinder-quobyte-9417f279-88e6-4abd-92fd-9f582a97d25b" acquired by "delete_volume" :: waited 0.026s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:53 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b336d03c-fb58-4e5d-84e5-98f89367a52f" returned: 0 in 0.465s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:12:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.585s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f101e48e-729a-49b1-9bcf-00469bfcbe77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f2446304b244b0b82a91d94eafd57eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:12:52Z,use_quota=True,user_id='ef2ea7e34e624b53897f65fabf3467d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:12:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Creating volume f101e48e-729a-49b1-9bcf-00469bfcbe77 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:12:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:12:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:12:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:12:53 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:12:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f101e48e-729a-49b1-9bcf-00469bfcbe77 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:53 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f486085d-b08a-4b01-bf4f-625e9da184ba]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8d37941a-e37c-40ec-94d4-f8e46d38d9d3 tempest-VolumesTransfersV355Test-733113559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9417f279-88e6-4abd-92fd-9f582a97d25b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:53 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f101e48e-729a-49b1-9bcf-00469bfcbe77 1073741824 Apr 27 10:12:53 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:53 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce60156e-857a-45f7-9699-9fa7f353ed64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b336d03c-fb58-4e5d-84e5-98f89367a52f', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:53 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d4b0851-79aa-400b-af41-f1948603d7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:53 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Volume volume-b336d03c-fb58-4e5d-84e5-98f89367a52f (b336d03c-fb58-4e5d-84e5-98f89367a52f): created successfully Apr 27 10:12:53 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d4b0851-79aa-400b-af41-f1948603d7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:53 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Flow 'volume_create_manager' (69d41f09-2c34-4c85-bb3e-d21d2795f590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:12:53 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-d17a21f9-2c11-4939-bc92-aa3704207fd7 tempest-GroupsTest-1457143907 None] Created volume successfully. Apr 27 10:12:53 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9417f279-88e6-4abd-92fd-9f582a97d25b Apr 27 10:12:53 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:54 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:54 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8d37941a-e37c-40ec-94d4-f8e46d38d9d3 tempest-VolumesTransfersV355Test-733113559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9417f279-88e6-4abd-92fd-9f582a97d25b" returned: 0 in 0.576s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8d37941a-e37c-40ec-94d4-f8e46d38d9d3 tempest-VolumesTransfersV355Test-733113559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9417f279-88e6-4abd-92fd-9f582a97d25b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f101e48e-729a-49b1-9bcf-00469bfcbe77 1073741824" returned: 0 in 0.600s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:54 devstack sudo[88612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9417f279-88e6-4abd-92fd-9f582a97d25b Apr 27 10:12:54 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f101e48e-729a-49b1-9bcf-00469bfcbe77 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:54 devstack sudo[88614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f101e48e-729a-49b1-9bcf-00469bfcbe77 Apr 27 10:12:54 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:54 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8d37941a-e37c-40ec-94d4-f8e46d38d9d3 tempest-VolumesTransfersV355Test-733113559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-9417f279-88e6-4abd-92fd-9f582a97d25b" returned: 0 in 0.466s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:54 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8d37941a-e37c-40ec-94d4-f8e46d38d9d3 tempest-VolumesTransfersV355Test-733113559 None] Lock "cinder-quobyte-9417f279-88e6-4abd-92fd-9f582a97d25b" released by "delete_volume" :: held 1.107s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:54 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f101e48e-729a-49b1-9bcf-00469bfcbe77" returned: 0 in 0.479s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:12:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7fb3eb-8785-4112-8af0-8b9af816167d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f101e48e-729a-49b1-9bcf-00469bfcbe77', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e54c9615-5320-4bbc-bf5a-694d7d055942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:54 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-8d37941a-e37c-40ec-94d4-f8e46d38d9d3 tempest-VolumesTransfersV355Test-733113559 None] Created reservations ['a150725a-00d1-4111-87c2-0724aa23c18a', 'ca45bc8f-a578-4abd-9f08-6324e627dcfc', '10fa984d-5386-4846-8443-d9190b1e5edb', 'b7e7f53e-fb36-4e95-be87-9eee11e67abf'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:12:54 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Volume volume-f101e48e-729a-49b1-9bcf-00469bfcbe77 (f101e48e-729a-49b1-9bcf-00469bfcbe77): created successfully Apr 27 10:12:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e54c9615-5320-4bbc-bf5a-694d7d055942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Flow 'volume_create_manager' (424cfebe-5f55-4b64-8c35-c8b78aa19ecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:12:54 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-b4035b75-334b-4716-ad81-80ec8bcafd96 tempest-CinderUnicodeTest-1269130606 None] Created volume successfully. Apr 27 10:12:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8d37941a-e37c-40ec-94d4-f8e46d38d9d3 tempest-VolumesTransfersV355Test-733113559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8d37941a-e37c-40ec-94d4-f8e46d38d9d3 tempest-VolumesTransfersV355Test-733113559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8d37941a-e37c-40ec-94d4-f8e46d38d9d3 tempest-VolumesTransfersV355Test-733113559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:12:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8d37941a-e37c-40ec-94d4-f8e46d38d9d3 tempest-VolumesTransfersV355Test-733113559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:12:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8d37941a-e37c-40ec-94d4-f8e46d38d9d3 tempest-VolumesTransfersV355Test-733113559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8d37941a-e37c-40ec-94d4-f8e46d38d9d3 tempest-VolumesTransfersV355Test-733113559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:54 devstack sudo[88619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:12:54 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-09c1b3bd-5cb4-4d1e-b0d4-cc9717baaaaf tempest-GroupsTest-1457143907 None] Acquiring lock "cinder-quobyte-b336d03c-fb58-4e5d-84e5-98f89367a52f" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-09c1b3bd-5cb4-4d1e-b0d4-cc9717baaaaf tempest-GroupsTest-1457143907 None] Lock "cinder-quobyte-b336d03c-fb58-4e5d-84e5-98f89367a52f" acquired by "delete_volume" :: waited 0.023s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[947bcb80-c8a3-43b9-bb47-d6449d373f80]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-09c1b3bd-5cb4-4d1e-b0d4-cc9717baaaaf tempest-GroupsTest-1457143907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b336d03c-fb58-4e5d-84e5-98f89367a52f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:55 devstack sudo[88622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b336d03c-fb58-4e5d-84e5-98f89367a52f Apr 27 10:12:55 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:55 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8d37941a-e37c-40ec-94d4-f8e46d38d9d3 tempest-VolumesTransfersV355Test-733113559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.496s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-8d37941a-e37c-40ec-94d4-f8e46d38d9d3 tempest-VolumesTransfersV355Test-733113559 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:12:55 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-8d37941a-e37c-40ec-94d4-f8e46d38d9d3 tempest-VolumesTransfersV355Test-733113559 None] Deleted volume successfully. Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8d37941a-e37c-40ec-94d4-f8e46d38d9d3 tempest-VolumesTransfersV355Test-733113559 None] Lock "cinder-9417f279-88e6-4abd-92fd-9f582a97d25b-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Flow 'volume_create_manager' (eb9e921f-1f17-4f3b-8325-06d411631cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fca53ff-e2d1-4cc0-92e6-551673765e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fca53ff-e2d1-4cc0-92e6-551673765e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:12:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1890758098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c38e1766-79e5-49fd-b1d9-1f9104a1128f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f2446304b244b0b82a91d94eafd57eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:12:55Z,use_quota=True,user_id='ef2ea7e34e624b53897f65fabf3467d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ff078e-3256-431d-919f-86a8e29161c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ff078e-3256-431d-919f-86a8e29161c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3dad59-ecfd-43f5-8f91-be47c7cf47c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3dad59-ecfd-43f5-8f91-be47c7cf47c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c38e1766-79e5-49fd-b1d9-1f9104a1128f', 'volume_name': 'volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d70e02-c1c5-4f9a-8e37-1def74be0980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d70e02-c1c5-4f9a-8e37-1def74be0980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df1b0687-a93e-457d-b087-d7ef57f284ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:55 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Volume c38e1766-79e5-49fd-b1d9-1f9104a1128f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f', 'volume_size': 1} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:12:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1890758098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c38e1766-79e5-49fd-b1d9-1f9104a1128f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f2446304b244b0b82a91d94eafd57eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:12:55Z,use_quota=True,user_id='ef2ea7e34e624b53897f65fabf3467d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Creating volume c38e1766-79e5-49fd-b1d9-1f9104a1128f {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:12:55 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:55 devstack sudo[88624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f 1073741824 Apr 27 10:12:55 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:55 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-09c1b3bd-5cb4-4d1e-b0d4-cc9717baaaaf tempest-GroupsTest-1457143907 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b336d03c-fb58-4e5d-84e5-98f89367a52f" returned: 0 in 0.568s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-09c1b3bd-5cb4-4d1e-b0d4-cc9717baaaaf tempest-GroupsTest-1457143907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b336d03c-fb58-4e5d-84e5-98f89367a52f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:55 devstack sudo[88629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b336d03c-fb58-4e5d-84e5-98f89367a52f Apr 27 10:12:55 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:56 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:56 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f 1073741824" returned: 0 in 0.807s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-09c1b3bd-5cb4-4d1e-b0d4-cc9717baaaaf tempest-GroupsTest-1457143907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b336d03c-fb58-4e5d-84e5-98f89367a52f" returned: 0 in 0.578s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:56 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-09c1b3bd-5cb4-4d1e-b0d4-cc9717baaaaf tempest-GroupsTest-1457143907 None] Lock "cinder-quobyte-b336d03c-fb58-4e5d-84e5-98f89367a52f" released by "delete_volume" :: held 1.189s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:12:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:56 devstack sudo[88667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f Apr 27 10:12:56 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:56 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-09c1b3bd-5cb4-4d1e-b0d4-cc9717baaaaf tempest-GroupsTest-1457143907 None] Created reservations ['cb5bc5a7-2c5b-4772-8eb7-9dc8fbacfd19'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:12:56 devstack cinder-volume[81350]: WARNING cinder.quota [None req-09c1b3bd-5cb4-4d1e-b0d4-cc9717baaaaf tempest-GroupsTest-1457143907 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1646194890 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1646194890, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:12:56 devstack cinder-volume[81350]: WARNING cinder.quota [None req-09c1b3bd-5cb4-4d1e-b0d4-cc9717baaaaf tempest-GroupsTest-1457143907 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1646194890 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1646194890, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:12:56 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-09c1b3bd-5cb4-4d1e-b0d4-cc9717baaaaf tempest-GroupsTest-1457143907 None] Created reservations ['f72fea96-afed-4564-9abf-0b1a0b99f466', 'f18067c7-ab86-4ffe-b60b-89516f23d215', '556ab6f7-203e-4175-a124-f364019d5443', '9cdc2b51-399f-45b1-86ac-46947ea44414'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:12:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-09c1b3bd-5cb4-4d1e-b0d4-cc9717baaaaf tempest-GroupsTest-1457143907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-09c1b3bd-5cb4-4d1e-b0d4-cc9717baaaaf tempest-GroupsTest-1457143907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-09c1b3bd-5cb4-4d1e-b0d4-cc9717baaaaf tempest-GroupsTest-1457143907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:12:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-09c1b3bd-5cb4-4d1e-b0d4-cc9717baaaaf tempest-GroupsTest-1457143907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:12:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-09c1b3bd-5cb4-4d1e-b0d4-cc9717baaaaf tempest-GroupsTest-1457143907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-09c1b3bd-5cb4-4d1e-b0d4-cc9717baaaaf tempest-GroupsTest-1457143907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:56 devstack sudo[88671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:12:56 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:56 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f" returned: 0 in 0.561s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:12:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df1b0687-a93e-457d-b087-d7ef57f284ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50932116-a07f-4471-962c-5143d57e0088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:12:56 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Volume volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f (c38e1766-79e5-49fd-b1d9-1f9104a1128f): created successfully Apr 27 10:12:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50932116-a07f-4471-962c-5143d57e0088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:12:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Flow 'volume_create_manager' (eb9e921f-1f17-4f3b-8325-06d411631cb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:12:56 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-cc830851-3e1f-4252-b3ae-766ef3772aae tempest-CinderUnicodeTest-1269130606 None] Created volume successfully. Apr 27 10:12:57 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-09c1b3bd-5cb4-4d1e-b0d4-cc9717baaaaf tempest-GroupsTest-1457143907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.507s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:57 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-09c1b3bd-5cb4-4d1e-b0d4-cc9717baaaaf tempest-GroupsTest-1457143907 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:12:57 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-09c1b3bd-5cb4-4d1e-b0d4-cc9717baaaaf tempest-GroupsTest-1457143907 None] Delete group completed successfully. Apr 27 10:12:57 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-e30e71b9-d48f-467b-a60f-f960376fa121 tempest-GroupsTest-1457143907 None] Created reservations ['1c6415d4-1792-4c76-850f-b31b91c01819'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:12:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e30e71b9-d48f-467b-a60f-f960376fa121 tempest-GroupsTest-1457143907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e30e71b9-d48f-467b-a60f-f960376fa121 tempest-GroupsTest-1457143907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e30e71b9-d48f-467b-a60f-f960376fa121 tempest-GroupsTest-1457143907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:12:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e30e71b9-d48f-467b-a60f-f960376fa121 tempest-GroupsTest-1457143907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:12:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e30e71b9-d48f-467b-a60f-f960376fa121 tempest-GroupsTest-1457143907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:12:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e30e71b9-d48f-467b-a60f-f960376fa121 tempest-GroupsTest-1457143907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:57 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:12:57 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ed433e99-10d4-4f86-a45a-0002ff5a8bf1 tempest-CinderUnicodeTest-1269130606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:12:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ed433e99-10d4-4f86-a45a-0002ff5a8bf1 tempest-CinderUnicodeTest-1269130606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:12:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-ed433e99-10d4-4f86-a45a-0002ff5a8bf1 tempest-CinderUnicodeTest-1269130606 None] Creating offline snapshot 735b8dbb-2b8a-4117-9172-7f94a43dda2e of volume c38e1766-79e5-49fd-b1d9-1f9104a1128f {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:12:57 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4e4d5b-323e-4104-9864-cc57a0854263]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:12:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ed433e99-10d4-4f86-a45a-0002ff5a8bf1 tempest-CinderUnicodeTest-1269130606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:57 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f Apr 27 10:12:57 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:58 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e30e71b9-d48f-467b-a60f-f960376fa121 tempest-GroupsTest-1457143907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.546s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:58 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-e30e71b9-d48f-467b-a60f-f960376fa121 tempest-GroupsTest-1457143907 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:12:58 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-e30e71b9-d48f-467b-a60f-f960376fa121 tempest-GroupsTest-1457143907 None] Delete group completed successfully. Apr 27 10:12:58 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ed433e99-10d4-4f86-a45a-0002ff5a8bf1 tempest-CinderUnicodeTest-1269130606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f" returned: 0 in 0.562s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ed433e99-10d4-4f86-a45a-0002ff5a8bf1 tempest-CinderUnicodeTest-1269130606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.735b8dbb-2b8a-4117-9172-7f94a43dda2e 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:58 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.735b8dbb-2b8a-4117-9172-7f94a43dda2e 1G Apr 27 10:12:58 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:59 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-9938ce6b-168a-453c-858e-bea8847c1341 tempest-GroupsTest-1457143907 None] Group tempest-GroupsTest-Group-1108062712: creating Apr 27 10:12:59 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-9938ce6b-168a-453c-858e-bea8847c1341 tempest-GroupsTest-1457143907 None] Group tempest-GroupsTest-Group-1108062712: created successfully Apr 27 10:12:59 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-9938ce6b-168a-453c-858e-bea8847c1341 tempest-GroupsTest-1457143907 None] Create group completed successfully. Apr 27 10:12:59 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ed433e99-10d4-4f86-a45a-0002ff5a8bf1 tempest-CinderUnicodeTest-1269130606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.735b8dbb-2b8a-4117-9172-7f94a43dda2e 1G" returned: 0 in 0.763s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ed433e99-10d4-4f86-a45a-0002ff5a8bf1 tempest-CinderUnicodeTest-1269130606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.735b8dbb-2b8a-4117-9172-7f94a43dda2e {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:59 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.735b8dbb-2b8a-4117-9172-7f94a43dda2e Apr 27 10:12:59 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:12:59 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 27 10:12:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ed433e99-10d4-4f86-a45a-0002ff5a8bf1 tempest-CinderUnicodeTest-1269130606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.735b8dbb-2b8a-4117-9172-7f94a43dda2e" returned: 0 in 0.513s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:12:59 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-ed433e99-10d4-4f86-a45a-0002ff5a8bf1 tempest-CinderUnicodeTest-1269130606 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.735b8dbb-2b8a-4117-9172-7f94a43dda2e is being set with open permissions: ugo+rw Apr 27 10:12:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ed433e99-10d4-4f86-a45a-0002ff5a8bf1 tempest-CinderUnicodeTest-1269130606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.735b8dbb-2b8a-4117-9172-7f94a43dda2e {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:12:59 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.735b8dbb-2b8a-4117-9172-7f94a43dda2e Apr 27 10:12:59 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:00 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ed433e99-10d4-4f86-a45a-0002ff5a8bf1 tempest-CinderUnicodeTest-1269130606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.735b8dbb-2b8a-4117-9172-7f94a43dda2e" returned: 0 in 0.512s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ed433e99-10d4-4f86-a45a-0002ff5a8bf1 tempest-CinderUnicodeTest-1269130606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:00 devstack sudo[88697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.info Apr 27 10:13:00 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Flow 'volume_create_manager' (41996a75-5758-48d3-826a-e6217276bb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e0ff5eb-93d7-44c9-8e87-1c6f831074ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e0ff5eb-93d7-44c9-8e87-1c6f831074ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-113788283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=898c732e-a4d8-4f51-88c4-bc5825e48155,host='devstack@QuobyteHD#QuobyteHD',id=dc44cef1-7e1e-4f27-bc33-afe6d599f211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88385a2d73054b88ac393cd16cbcc31c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:01Z,use_quota=True,user_id='56e1e6b5dc54460e90f9d86b8f7e0d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64d87331-7c24-4af5-9ca9-71d1eea89f82),volume_type_id=64d87331-7c24-4af5-9ca9-71d1eea89f82)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d426a8e-cdf6-4f32-8201-d5596de65047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d426a8e-cdf6-4f32-8201-d5596de65047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e170f7-95cc-4b34-8a20-3ed158ffe570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e170f7-95cc-4b34-8a20-3ed158ffe570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc44cef1-7e1e-4f27-bc33-afe6d599f211', 'volume_name': 'volume-dc44cef1-7e1e-4f27-bc33-afe6d599f211', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198e2603-0dba-4009-894e-2486f7f6d99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198e2603-0dba-4009-894e-2486f7f6d99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76bc0c9a-d09f-4cc8-878f-d066fe50a70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:00 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Volume dc44cef1-7e1e-4f27-bc33-afe6d599f211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc44cef1-7e1e-4f27-bc33-afe6d599f211', 'volume_size': 1} Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Flow 'volume_create_manager' (13ad64f2-9cd4-43e0-bfe2-fa20b9b329e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d3e6e5a-15d3-4259-adff-a17dae578d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:00 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d3e6e5a-15d3-4259-adff-a17dae578d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-306768016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7b909b-fc9a-488a-aae1-27d34ab3746b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a4dee690a7fd41d3a3007b43cdb8d744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:01Z,use_quota=True,user_id='cfb2332f34f14f5187bd058c590656e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d201a3-131c-4637-9118-7d87c42354c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d201a3-131c-4637-9118-7d87c42354c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6cee61f-9d50-4e18-9001-68fa572f43ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6cee61f-9d50-4e18-9001-68fa572f43ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b7b909b-fc9a-488a-aae1-27d34ab3746b', 'volume_name': 'volume-8b7b909b-fc9a-488a-aae1-27d34ab3746b', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84fe8d0-0ed2-4b15-b487-cfb8deb983e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84fe8d0-0ed2-4b15-b487-cfb8deb983e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d429d892-4ca9-48aa-a222-4ed1fa44fc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:00 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Volume 8b7b909b-fc9a-488a-aae1-27d34ab3746b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b7b909b-fc9a-488a-aae1-27d34ab3746b', 'volume_size': 1} Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ed433e99-10d4-4f86-a45a-0002ff5a8bf1 tempest-CinderUnicodeTest-1269130606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.info" returned: 0 in 0.567s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:00 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-ed433e99-10d4-4f86-a45a-0002ff5a8bf1 tempest-CinderUnicodeTest-1269130606 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.info is being set with open permissions: ugo+rw Apr 27 10:13:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ed433e99-10d4-4f86-a45a-0002ff5a8bf1 tempest-CinderUnicodeTest-1269130606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:00 devstack sudo[88700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.info Apr 27 10:13:00 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:01 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ed433e99-10d4-4f86-a45a-0002ff5a8bf1 tempest-CinderUnicodeTest-1269130606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.info" returned: 0 in 0.429s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ed433e99-10d4-4f86-a45a-0002ff5a8bf1 tempest-CinderUnicodeTest-1269130606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.458s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.553s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=898c732e-a4d8-4f51-88c4-bc5825e48155,created_at=2026-04-27T08:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-113788283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=898c732e-a4d8-4f51-88c4-bc5825e48155,host='devstack@QuobyteHD#QuobyteHD',id=dc44cef1-7e1e-4f27-bc33-afe6d599f211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88385a2d73054b88ac393cd16cbcc31c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:01Z,use_quota=True,user_id='56e1e6b5dc54460e90f9d86b8f7e0d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64d87331-7c24-4af5-9ca9-71d1eea89f82),volume_type_id=64d87331-7c24-4af5-9ca9-71d1eea89f82)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:13:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Creating volume dc44cef1-7e1e-4f27-bc33-afe6d599f211 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:13:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:13:01 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:13:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dc44cef1-7e1e-4f27-bc33-afe6d599f211 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:01 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dc44cef1-7e1e-4f27-bc33-afe6d599f211 1073741824 Apr 27 10:13:01 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:01 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-ed433e99-10d4-4f86-a45a-0002ff5a8bf1 tempest-CinderUnicodeTest-1269130606 None] Create snapshot completed successfully Apr 27 10:13:01 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dc44cef1-7e1e-4f27-bc33-afe6d599f211 1073741824" returned: 0 in 0.606s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dc44cef1-7e1e-4f27-bc33-afe6d599f211 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:01 devstack sudo[88708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dc44cef1-7e1e-4f27-bc33-afe6d599f211 Apr 27 10:13:01 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-59b77752-7fb2-49dc-8d2e-6d1a48f07f2d tempest-CinderUnicodeTest-1269130606 None] Acquiring lock "cinder-735b8dbb-2b8a-4117-9172-7f94a43dda2e-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-59b77752-7fb2-49dc-8d2e-6d1a48f07f2d tempest-CinderUnicodeTest-1269130606 None] Lock "cinder-735b8dbb-2b8a-4117-9172-7f94a43dda2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-59b77752-7fb2-49dc-8d2e-6d1a48f07f2d tempest-CinderUnicodeTest-1269130606 None] Acquiring lock "cinder-quobyte-c38e1766-79e5-49fd-b1d9-1f9104a1128f" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-59b77752-7fb2-49dc-8d2e-6d1a48f07f2d tempest-CinderUnicodeTest-1269130606 None] Lock "cinder-quobyte-c38e1766-79e5-49fd-b1d9-1f9104a1128f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-59b77752-7fb2-49dc-8d2e-6d1a48f07f2d tempest-CinderUnicodeTest-1269130606 None] Acquiring lock "cinder-quobyte-735b8dbb-2b8a-4117-9172-7f94a43dda2e" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-59b77752-7fb2-49dc-8d2e-6d1a48f07f2d tempest-CinderUnicodeTest-1269130606 None] Lock "cinder-quobyte-735b8dbb-2b8a-4117-9172-7f94a43dda2e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-59b77752-7fb2-49dc-8d2e-6d1a48f07f2d tempest-CinderUnicodeTest-1269130606 None] Deleting offline snapshot 735b8dbb-2b8a-4117-9172-7f94a43dda2e of volume c38e1766-79e5-49fd-b1d9-1f9104a1128f {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-59b77752-7fb2-49dc-8d2e-6d1a48f07f2d tempest-CinderUnicodeTest-1269130606 None] snapshot_file for this snap is: volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.735b8dbb-2b8a-4117-9172-7f94a43dda2e {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c392d43c-30e4-4143-93b8-0bd3ef2de5a4]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-59b77752-7fb2-49dc-8d2e-6d1a48f07f2d tempest-CinderUnicodeTest-1269130606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.735b8dbb-2b8a-4117-9172-7f94a43dda2e {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:02 devstack sudo[88710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.735b8dbb-2b8a-4117-9172-7f94a43dda2e Apr 27 10:13:02 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:02 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dc44cef1-7e1e-4f27-bc33-afe6d599f211" returned: 0 in 0.509s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.608s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-306768016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7b909b-fc9a-488a-aae1-27d34ab3746b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a4dee690a7fd41d3a3007b43cdb8d744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:01Z,use_quota=True,user_id='cfb2332f34f14f5187bd058c590656e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Creating volume 8b7b909b-fc9a-488a-aae1-27d34ab3746b {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:13:02 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8b7b909b-fc9a-488a-aae1-27d34ab3746b 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76bc0c9a-d09f-4cc8-878f-d066fe50a70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc44cef1-7e1e-4f27-bc33-afe6d599f211', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:02 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8b7b909b-fc9a-488a-aae1-27d34ab3746b 1073741824 Apr 27 10:13:02 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c62e7d0b-3e8b-4ec3-96ae-f731643e19fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:02 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Volume volume-dc44cef1-7e1e-4f27-bc33-afe6d599f211 (dc44cef1-7e1e-4f27-bc33-afe6d599f211): created successfully Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c62e7d0b-3e8b-4ec3-96ae-f731643e19fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Flow 'volume_create_manager' (41996a75-5758-48d3-826a-e6217276bb73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:02 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-7a3d27af-c1dd-40d1-89e5-65e3238a2fd7 tempest-GroupsTest-1457143907 None] Created volume successfully. Apr 27 10:13:02 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-59b77752-7fb2-49dc-8d2e-6d1a48f07f2d tempest-CinderUnicodeTest-1269130606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.735b8dbb-2b8a-4117-9172-7f94a43dda2e" returned: 0 in 0.547s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-59b77752-7fb2-49dc-8d2e-6d1a48f07f2d tempest-CinderUnicodeTest-1269130606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3055135-2e0b-45e9-8a7f-b8170eff0e13]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-59b77752-7fb2-49dc-8d2e-6d1a48f07f2d tempest-CinderUnicodeTest-1269130606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:02 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f Apr 27 10:13:02 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:03 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8b7b909b-fc9a-488a-aae1-27d34ab3746b 1073741824" returned: 0 in 0.708s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8b7b909b-fc9a-488a-aae1-27d34ab3746b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:03 devstack sudo[88725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8b7b909b-fc9a-488a-aae1-27d34ab3746b Apr 27 10:13:03 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Flow 'volume_create_manager' (0b11655f-2a93-4b81-81a5-a75961429bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc5c23a-5a66-4f4c-8d45-6e72a9ffde85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc5c23a-5a66-4f4c-8d45-6e72a9ffde85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1641739011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=898c732e-a4d8-4f51-88c4-bc5825e48155,host='devstack@QuobyteHD#QuobyteHD',id=2b8bc583-900c-4337-98eb-af3611b52aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88385a2d73054b88ac393cd16cbcc31c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:03Z,use_quota=True,user_id='56e1e6b5dc54460e90f9d86b8f7e0d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64d87331-7c24-4af5-9ca9-71d1eea89f82),volume_type_id=64d87331-7c24-4af5-9ca9-71d1eea89f82)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bfced1b-c1ba-45e3-b389-971355d4bebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bfced1b-c1ba-45e3-b389-971355d4bebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686b49e8-4a0f-4222-af70-6a3f12b7e92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686b49e8-4a0f-4222-af70-6a3f12b7e92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b8bc583-900c-4337-98eb-af3611b52aac', 'volume_name': 'volume-2b8bc583-900c-4337-98eb-af3611b52aac', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bde5e67-1164-4552-8811-b4fed141fa84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bde5e67-1164-4552-8811-b4fed141fa84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c689d132-aba8-4da7-b965-074dd1e00213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:03 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Volume 2b8bc583-900c-4337-98eb-af3611b52aac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b8bc583-900c-4337-98eb-af3611b52aac', 'volume_size': 1} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:03 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-59b77752-7fb2-49dc-8d2e-6d1a48f07f2d tempest-CinderUnicodeTest-1269130606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f" returned: 0 in 0.675s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-59b77752-7fb2-49dc-8d2e-6d1a48f07f2d tempest-CinderUnicodeTest-1269130606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.735b8dbb-2b8a-4117-9172-7f94a43dda2e {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:03 devstack sudo[88730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.735b8dbb-2b8a-4117-9172-7f94a43dda2e Apr 27 10:13:03 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:03 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8b7b909b-fc9a-488a-aae1-27d34ab3746b" returned: 0 in 0.454s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=898c732e-a4d8-4f51-88c4-bc5825e48155,created_at=2026-04-27T08:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1641739011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=898c732e-a4d8-4f51-88c4-bc5825e48155,host='devstack@QuobyteHD#QuobyteHD',id=2b8bc583-900c-4337-98eb-af3611b52aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88385a2d73054b88ac393cd16cbcc31c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:03Z,use_quota=True,user_id='56e1e6b5dc54460e90f9d86b8f7e0d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64d87331-7c24-4af5-9ca9-71d1eea89f82),volume_type_id=64d87331-7c24-4af5-9ca9-71d1eea89f82)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Creating volume 2b8bc583-900c-4337-98eb-af3611b52aac {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:13:03 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-2b8bc583-900c-4337-98eb-af3611b52aac 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d429d892-4ca9-48aa-a222-4ed1fa44fc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b7b909b-fc9a-488a-aae1-27d34ab3746b', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da0d458-592a-4f3f-befa-05d6dff844bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:03 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-2b8bc583-900c-4337-98eb-af3611b52aac 1073741824 Apr 27 10:13:03 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:03 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Volume volume-8b7b909b-fc9a-488a-aae1-27d34ab3746b (8b7b909b-fc9a-488a-aae1-27d34ab3746b): created successfully Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da0d458-592a-4f3f-befa-05d6dff844bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Flow 'volume_create_manager' (13ad64f2-9cd4-43e0-bfe2-fa20b9b329e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:03 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-26f4d3f5-6ff0-49a7-933a-fb2abb1ba12c tempest-VolumesGetTest-906688629 None] Created volume successfully. Apr 27 10:13:04 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-59b77752-7fb2-49dc-8d2e-6d1a48f07f2d tempest-CinderUnicodeTest-1269130606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.735b8dbb-2b8a-4117-9172-7f94a43dda2e" returned: 0 in 0.609s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-59b77752-7fb2-49dc-8d2e-6d1a48f07f2d tempest-CinderUnicodeTest-1269130606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.735b8dbb-2b8a-4117-9172-7f94a43dda2e {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:04 devstack sudo[88738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.735b8dbb-2b8a-4117-9172-7f94a43dda2e Apr 27 10:13:04 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:04 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-2b8bc583-900c-4337-98eb-af3611b52aac 1073741824" returned: 0 in 0.709s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-2b8bc583-900c-4337-98eb-af3611b52aac {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:04 devstack sudo[88743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-2b8bc583-900c-4337-98eb-af3611b52aac Apr 27 10:13:04 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:04 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-59b77752-7fb2-49dc-8d2e-6d1a48f07f2d tempest-CinderUnicodeTest-1269130606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f.735b8dbb-2b8a-4117-9172-7f94a43dda2e" returned: 0 in 0.508s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-59b77752-7fb2-49dc-8d2e-6d1a48f07f2d tempest-CinderUnicodeTest-1269130606 None] Lock "cinder-quobyte-735b8dbb-2b8a-4117-9172-7f94a43dda2e" released by "_delete_snapshot" :: held 2.475s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-59b77752-7fb2-49dc-8d2e-6d1a48f07f2d tempest-CinderUnicodeTest-1269130606 None] Lock "cinder-quobyte-c38e1766-79e5-49fd-b1d9-1f9104a1128f" released by "delete_snapshot" :: held 2.498s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Flow 'volume_create_manager' (6efd625d-6f27-4a5f-80ad-d9d744b52beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb7b6e87-99a7-42c7-b6dc-b582924425a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb7b6e87-99a7-42c7-b6dc-b582924425a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:13:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-397907972',display_name='tempest-VolumesGetTest-Volume-733490505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=235e2760-af1c-4927-b38d-c6395ddc4577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4dee690a7fd41d3a3007b43cdb8d744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:05Z,use_quota=True,user_id='cfb2332f34f14f5187bd058c590656e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb190fce-e92a-420f-a4d4-3ad3d46d79de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb190fce-e92a-420f-a4d4-3ad3d46d79de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f42d5e7-ebab-44d9-9370-29ecffb64fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f42d5e7-ebab-44d9-9370-29ecffb64fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '235e2760-af1c-4927-b38d-c6395ddc4577', 'volume_name': 'volume-235e2760-af1c-4927-b38d-c6395ddc4577', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0e27ab-b2ad-4e84-820d-bf75d36c7e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0e27ab-b2ad-4e84-820d-bf75d36c7e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47c1655-89c0-443e-9429-430cf5f8c008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:04 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Volume 235e2760-af1c-4927-b38d-c6395ddc4577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-235e2760-af1c-4927-b38d-c6395ddc4577', 'volume_size': 1} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-59b77752-7fb2-49dc-8d2e-6d1a48f07f2d tempest-CinderUnicodeTest-1269130606 None] Created reservations ['b3e0706b-99a2-4f42-a86f-299a26693f26', 'faf6ecdc-25b4-411b-8b40-4b39847d783c', 'a430cfe7-a55c-4e4b-9274-7a6096d1b008', 'ca856bed-a0d4-4adc-a936-2323e365aad2'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:13:04 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-59b77752-7fb2-49dc-8d2e-6d1a48f07f2d tempest-CinderUnicodeTest-1269130606 None] Delete snapshot completed successfully. Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-59b77752-7fb2-49dc-8d2e-6d1a48f07f2d tempest-CinderUnicodeTest-1269130606 None] Lock "cinder-735b8dbb-2b8a-4117-9172-7f94a43dda2e-delete_snapshot" released by "delete_snapshot" :: held 2.715s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:04 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-2b8bc583-900c-4337-98eb-af3611b52aac" returned: 0 in 0.514s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.237s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:13:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-397907972',display_name='tempest-VolumesGetTest-Volume-733490505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=235e2760-af1c-4927-b38d-c6395ddc4577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4dee690a7fd41d3a3007b43cdb8d744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:05Z,use_quota=True,user_id='cfb2332f34f14f5187bd058c590656e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Creating volume 235e2760-af1c-4927-b38d-c6395ddc4577 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:13:04 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:13:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-235e2760-af1c-4927-b38d-c6395ddc4577 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:05 devstack sudo[88748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-235e2760-af1c-4927-b38d-c6395ddc4577 1073741824 Apr 27 10:13:05 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:05 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c689d132-aba8-4da7-b965-074dd1e00213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b8bc583-900c-4337-98eb-af3611b52aac', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:05 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4125c5c9-a9b8-4eb9-a76e-1e4d39f2dd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:05 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Volume volume-2b8bc583-900c-4337-98eb-af3611b52aac (2b8bc583-900c-4337-98eb-af3611b52aac): created successfully Apr 27 10:13:05 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4125c5c9-a9b8-4eb9-a76e-1e4d39f2dd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:05 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Flow 'volume_create_manager' (0b11655f-2a93-4b81-81a5-a75961429bb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:05 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-d2c5c551-85f5-40fb-90da-3e6c6f11f659 tempest-GroupsTest-1457143907 None] Created volume successfully. Apr 27 10:13:05 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5edb6a4f-7bc9-4580-b7f7-5c711aa8ee2d tempest-CinderUnicodeTest-1269130606 None] Acquiring lock "cinder-c38e1766-79e5-49fd-b1d9-1f9104a1128f-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:05 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5edb6a4f-7bc9-4580-b7f7-5c711aa8ee2d tempest-CinderUnicodeTest-1269130606 None] Lock "cinder-c38e1766-79e5-49fd-b1d9-1f9104a1128f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:05 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5edb6a4f-7bc9-4580-b7f7-5c711aa8ee2d tempest-CinderUnicodeTest-1269130606 None] Acquiring lock "cinder-quobyte-c38e1766-79e5-49fd-b1d9-1f9104a1128f" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:05 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5edb6a4f-7bc9-4580-b7f7-5c711aa8ee2d tempest-CinderUnicodeTest-1269130606 None] Lock "cinder-quobyte-c38e1766-79e5-49fd-b1d9-1f9104a1128f" acquired by "delete_volume" :: waited 0.014s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:05 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18abc3c-31c8-4684-817a-ec555efe0198]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5edb6a4f-7bc9-4580-b7f7-5c711aa8ee2d tempest-CinderUnicodeTest-1269130606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:05 devstack sudo[88752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f Apr 27 10:13:05 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:05 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-463f1146-3ddf-42c2-856e-db2792b5ec48 tempest-GroupsTest-1457143907 None] Update group completed successfully. Apr 27 10:13:05 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-235e2760-af1c-4927-b38d-c6395ddc4577 1073741824" returned: 0 in 0.717s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-235e2760-af1c-4927-b38d-c6395ddc4577 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:05 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-235e2760-af1c-4927-b38d-c6395ddc4577 Apr 27 10:13:05 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:05 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5edb6a4f-7bc9-4580-b7f7-5c711aa8ee2d tempest-CinderUnicodeTest-1269130606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f" returned: 0 in 0.619s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5edb6a4f-7bc9-4580-b7f7-5c711aa8ee2d tempest-CinderUnicodeTest-1269130606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:06 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f Apr 27 10:13:06 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:06 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-235e2760-af1c-4927-b38d-c6395ddc4577" returned: 0 in 0.442s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:06 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:13:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47c1655-89c0-443e-9429-430cf5f8c008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-235e2760-af1c-4927-b38d-c6395ddc4577', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (569069bf-4223-40ae-bb20-cb18c3466211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:06 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Volume volume-235e2760-af1c-4927-b38d-c6395ddc4577 (235e2760-af1c-4927-b38d-c6395ddc4577): created successfully Apr 27 10:13:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (569069bf-4223-40ae-bb20-cb18c3466211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:06 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Flow 'volume_create_manager' (6efd625d-6f27-4a5f-80ad-d9d744b52beb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:06 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-790f24f0-1e4e-4fc1-9825-c5273d5004f7 tempest-VolumesGetTest-906688629 None] Created volume successfully. Apr 27 10:13:06 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5edb6a4f-7bc9-4580-b7f7-5c711aa8ee2d tempest-CinderUnicodeTest-1269130606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c38e1766-79e5-49fd-b1d9-1f9104a1128f" returned: 0 in 0.440s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5edb6a4f-7bc9-4580-b7f7-5c711aa8ee2d tempest-CinderUnicodeTest-1269130606 None] Lock "cinder-quobyte-c38e1766-79e5-49fd-b1d9-1f9104a1128f" released by "delete_volume" :: held 1.121s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:06 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-5edb6a4f-7bc9-4580-b7f7-5c711aa8ee2d tempest-CinderUnicodeTest-1269130606 None] Created reservations ['8eed2c57-520f-48cb-a65b-f28fa6e7e443', '719c8de5-6e72-4a98-99af-146a8004e07f', 'fb4f9eac-4428-4a16-be26-bbe08ee087d9', 'c3d50faf-435c-4d91-aa63-9bae8793b9c6'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:13:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5edb6a4f-7bc9-4580-b7f7-5c711aa8ee2d tempest-CinderUnicodeTest-1269130606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5edb6a4f-7bc9-4580-b7f7-5c711aa8ee2d tempest-CinderUnicodeTest-1269130606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:06 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5edb6a4f-7bc9-4580-b7f7-5c711aa8ee2d tempest-CinderUnicodeTest-1269130606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:06 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5edb6a4f-7bc9-4580-b7f7-5c711aa8ee2d tempest-CinderUnicodeTest-1269130606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5edb6a4f-7bc9-4580-b7f7-5c711aa8ee2d tempest-CinderUnicodeTest-1269130606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5edb6a4f-7bc9-4580-b7f7-5c711aa8ee2d tempest-CinderUnicodeTest-1269130606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:06 devstack sudo[88764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:13:06 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-70fee7fd-9df9-43c0-bdd7-7da102bb36be tempest-VolumesGetTest-906688629 None] Acquiring lock "cinder-235e2760-af1c-4927-b38d-c6395ddc4577-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-70fee7fd-9df9-43c0-bdd7-7da102bb36be tempest-VolumesGetTest-906688629 None] Lock "cinder-235e2760-af1c-4927-b38d-c6395ddc4577-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-70fee7fd-9df9-43c0-bdd7-7da102bb36be tempest-VolumesGetTest-906688629 None] Acquiring lock "cinder-quobyte-235e2760-af1c-4927-b38d-c6395ddc4577" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:07 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-70fee7fd-9df9-43c0-bdd7-7da102bb36be tempest-VolumesGetTest-906688629 None] Lock "cinder-quobyte-235e2760-af1c-4927-b38d-c6395ddc4577" acquired by "delete_volume" :: waited 0.032s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:07 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-77540e05-3748-4cb0-8df1-387fe7c1ce37 tempest-GroupsTest-1457143907 None] Update group completed successfully. Apr 27 10:13:07 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[732745d5-51b5-4952-ba98-f3052a2e72c2]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-70fee7fd-9df9-43c0-bdd7-7da102bb36be tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-235e2760-af1c-4927-b38d-c6395ddc4577 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:07 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5edb6a4f-7bc9-4580-b7f7-5c711aa8ee2d tempest-CinderUnicodeTest-1269130606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.495s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:07 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-5edb6a4f-7bc9-4580-b7f7-5c711aa8ee2d tempest-CinderUnicodeTest-1269130606 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:13:07 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-5edb6a4f-7bc9-4580-b7f7-5c711aa8ee2d tempest-CinderUnicodeTest-1269130606 None] Deleted volume successfully. Apr 27 10:13:07 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5edb6a4f-7bc9-4580-b7f7-5c711aa8ee2d tempest-CinderUnicodeTest-1269130606 None] Lock "cinder-c38e1766-79e5-49fd-b1d9-1f9104a1128f-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:07 devstack sudo[88767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-235e2760-af1c-4927-b38d-c6395ddc4577 Apr 27 10:13:07 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:07 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d7964b31-c52a-4144-9a0f-ab2f48c1b355 tempest-CinderUnicodeTest-1269130606 None] Acquiring lock "cinder-f101e48e-729a-49b1-9bcf-00469bfcbe77-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:07 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d7964b31-c52a-4144-9a0f-ab2f48c1b355 tempest-CinderUnicodeTest-1269130606 None] Lock "cinder-f101e48e-729a-49b1-9bcf-00469bfcbe77-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:07 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d7964b31-c52a-4144-9a0f-ab2f48c1b355 tempest-CinderUnicodeTest-1269130606 None] Acquiring lock "cinder-quobyte-f101e48e-729a-49b1-9bcf-00469bfcbe77" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:07 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-70fee7fd-9df9-43c0-bdd7-7da102bb36be tempest-VolumesGetTest-906688629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-235e2760-af1c-4927-b38d-c6395ddc4577" returned: 0 in 0.523s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-70fee7fd-9df9-43c0-bdd7-7da102bb36be tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-235e2760-af1c-4927-b38d-c6395ddc4577 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:07 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d7964b31-c52a-4144-9a0f-ab2f48c1b355 tempest-CinderUnicodeTest-1269130606 None] Lock "cinder-quobyte-f101e48e-729a-49b1-9bcf-00469bfcbe77" acquired by "delete_volume" :: waited 0.032s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:07 devstack sudo[88772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-235e2760-af1c-4927-b38d-c6395ddc4577 Apr 27 10:13:07 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:07 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[be564d00-fd98-448a-8fc1-b84b2d315bf5]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d7964b31-c52a-4144-9a0f-ab2f48c1b355 tempest-CinderUnicodeTest-1269130606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f101e48e-729a-49b1-9bcf-00469bfcbe77 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:07 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f101e48e-729a-49b1-9bcf-00469bfcbe77 Apr 27 10:13:07 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:08 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-70fee7fd-9df9-43c0-bdd7-7da102bb36be tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-235e2760-af1c-4927-b38d-c6395ddc4577" returned: 0 in 0.459s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-70fee7fd-9df9-43c0-bdd7-7da102bb36be tempest-VolumesGetTest-906688629 None] Lock "cinder-quobyte-235e2760-af1c-4927-b38d-c6395ddc4577" released by "delete_volume" :: held 1.030s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-70fee7fd-9df9-43c0-bdd7-7da102bb36be tempest-VolumesGetTest-906688629 None] Created reservations ['ae2982a7-5d64-4568-9e1b-575b4f8e34c0', 'acc55895-7ec0-4686-99f6-dbad6a9b525b', '1ce77758-27ae-469c-9ff3-7ef26ac06f8e', 'c5e975be-5a65-441a-a2a8-4a80acc8cd1d'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-70fee7fd-9df9-43c0-bdd7-7da102bb36be tempest-VolumesGetTest-906688629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-70fee7fd-9df9-43c0-bdd7-7da102bb36be tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-70fee7fd-9df9-43c0-bdd7-7da102bb36be tempest-VolumesGetTest-906688629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-70fee7fd-9df9-43c0-bdd7-7da102bb36be tempest-VolumesGetTest-906688629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-70fee7fd-9df9-43c0-bdd7-7da102bb36be tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-70fee7fd-9df9-43c0-bdd7-7da102bb36be tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:08 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d7964b31-c52a-4144-9a0f-ab2f48c1b355 tempest-CinderUnicodeTest-1269130606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f101e48e-729a-49b1-9bcf-00469bfcbe77" returned: 0 in 0.571s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d7964b31-c52a-4144-9a0f-ab2f48c1b355 tempest-CinderUnicodeTest-1269130606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f101e48e-729a-49b1-9bcf-00469bfcbe77 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:08 devstack sudo[88780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:13:08 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:08 devstack sudo[88781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f101e48e-729a-49b1-9bcf-00469bfcbe77 Apr 27 10:13:08 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] Acquiring lock "cinder-quobyte-2b8bc583-900c-4337-98eb-af3611b52aac" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] Lock "cinder-quobyte-2b8bc583-900c-4337-98eb-af3611b52aac" acquired by "delete_volume" :: waited 0.019s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdd189e-fd78-4a79-b49f-84d4b3cd95d4]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-2b8bc583-900c-4337-98eb-af3611b52aac {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:08 devstack sudo[88784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-2b8bc583-900c-4337-98eb-af3611b52aac Apr 27 10:13:08 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:08 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d7964b31-c52a-4144-9a0f-ab2f48c1b355 tempest-CinderUnicodeTest-1269130606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-f101e48e-729a-49b1-9bcf-00469bfcbe77" returned: 0 in 0.485s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:08 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-70fee7fd-9df9-43c0-bdd7-7da102bb36be tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.513s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-70fee7fd-9df9-43c0-bdd7-7da102bb36be tempest-VolumesGetTest-906688629 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:13:08 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-70fee7fd-9df9-43c0-bdd7-7da102bb36be tempest-VolumesGetTest-906688629 None] Deleted volume successfully. Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d7964b31-c52a-4144-9a0f-ab2f48c1b355 tempest-CinderUnicodeTest-1269130606 None] Lock "cinder-quobyte-f101e48e-729a-49b1-9bcf-00469bfcbe77" released by "delete_volume" :: held 1.108s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-70fee7fd-9df9-43c0-bdd7-7da102bb36be tempest-VolumesGetTest-906688629 None] Lock "cinder-235e2760-af1c-4927-b38d-c6395ddc4577-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-d7964b31-c52a-4144-9a0f-ab2f48c1b355 tempest-CinderUnicodeTest-1269130606 None] Created reservations ['72425a5a-1380-4564-b356-420bb1673955', '1c192f5a-5b9a-4c9d-bcfa-4dafcfd05aeb', '1703a41c-12db-4a98-890b-d42c482c891f', 'c73f3496-66a8-4476-b3c7-b95edfb57d1a'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d7964b31-c52a-4144-9a0f-ab2f48c1b355 tempest-CinderUnicodeTest-1269130606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d7964b31-c52a-4144-9a0f-ab2f48c1b355 tempest-CinderUnicodeTest-1269130606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d7964b31-c52a-4144-9a0f-ab2f48c1b355 tempest-CinderUnicodeTest-1269130606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d7964b31-c52a-4144-9a0f-ab2f48c1b355 tempest-CinderUnicodeTest-1269130606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d7964b31-c52a-4144-9a0f-ab2f48c1b355 tempest-CinderUnicodeTest-1269130606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d7964b31-c52a-4144-9a0f-ab2f48c1b355 tempest-CinderUnicodeTest-1269130606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:08 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:13:08 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:08 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-2b8bc583-900c-4337-98eb-af3611b52aac" returned: 0 in 0.535s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-2b8bc583-900c-4337-98eb-af3611b52aac {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:08 devstack sudo[88793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-2b8bc583-900c-4337-98eb-af3611b52aac Apr 27 10:13:08 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:09 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-904b9b34-478c-43f6-a0fd-e36b67a8d216 tempest-VolumesGetTest-906688629 None] Acquiring lock "cinder-8b7b909b-fc9a-488a-aae1-27d34ab3746b-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:09 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-904b9b34-478c-43f6-a0fd-e36b67a8d216 tempest-VolumesGetTest-906688629 None] Lock "cinder-8b7b909b-fc9a-488a-aae1-27d34ab3746b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:09 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-904b9b34-478c-43f6-a0fd-e36b67a8d216 tempest-VolumesGetTest-906688629 None] Acquiring lock "cinder-quobyte-8b7b909b-fc9a-488a-aae1-27d34ab3746b" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:09 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-904b9b34-478c-43f6-a0fd-e36b67a8d216 tempest-VolumesGetTest-906688629 None] Lock "cinder-quobyte-8b7b909b-fc9a-488a-aae1-27d34ab3746b" acquired by "delete_volume" :: waited 0.029s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:09 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b22a306-2565-4a7b-b8eb-e056d5f8c620]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-904b9b34-478c-43f6-a0fd-e36b67a8d216 tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8b7b909b-fc9a-488a-aae1-27d34ab3746b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:09 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d7964b31-c52a-4144-9a0f-ab2f48c1b355 tempest-CinderUnicodeTest-1269130606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.504s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:09 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-d7964b31-c52a-4144-9a0f-ab2f48c1b355 tempest-CinderUnicodeTest-1269130606 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:13:09 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-d7964b31-c52a-4144-9a0f-ab2f48c1b355 tempest-CinderUnicodeTest-1269130606 None] Deleted volume successfully. Apr 27 10:13:09 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8b7b909b-fc9a-488a-aae1-27d34ab3746b Apr 27 10:13:09 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:09 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d7964b31-c52a-4144-9a0f-ab2f48c1b355 tempest-CinderUnicodeTest-1269130606 None] Lock "cinder-f101e48e-729a-49b1-9bcf-00469bfcbe77-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:09 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-2b8bc583-900c-4337-98eb-af3611b52aac" returned: 0 in 0.517s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:09 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] Lock "cinder-quobyte-2b8bc583-900c-4337-98eb-af3611b52aac" released by "delete_volume" :: held 1.112s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:09 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] Acquiring lock "cinder-quobyte-dc44cef1-7e1e-4f27-bc33-afe6d599f211" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:09 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] Lock "cinder-quobyte-dc44cef1-7e1e-4f27-bc33-afe6d599f211" acquired by "delete_volume" :: waited 0.017s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:09 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36614e1-c81b-4168-b3a9-81623c90c97f]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dc44cef1-7e1e-4f27-bc33-afe6d599f211 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:09 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dc44cef1-7e1e-4f27-bc33-afe6d599f211 Apr 27 10:13:09 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:09 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-904b9b34-478c-43f6-a0fd-e36b67a8d216 tempest-VolumesGetTest-906688629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8b7b909b-fc9a-488a-aae1-27d34ab3746b" returned: 0 in 0.610s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-904b9b34-478c-43f6-a0fd-e36b67a8d216 tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8b7b909b-fc9a-488a-aae1-27d34ab3746b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:09 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8b7b909b-fc9a-488a-aae1-27d34ab3746b Apr 27 10:13:09 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:10 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dc44cef1-7e1e-4f27-bc33-afe6d599f211" returned: 0 in 0.613s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dc44cef1-7e1e-4f27-bc33-afe6d599f211 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:10 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dc44cef1-7e1e-4f27-bc33-afe6d599f211 Apr 27 10:13:10 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:10 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-904b9b34-478c-43f6-a0fd-e36b67a8d216 tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8b7b909b-fc9a-488a-aae1-27d34ab3746b" returned: 0 in 0.552s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-904b9b34-478c-43f6-a0fd-e36b67a8d216 tempest-VolumesGetTest-906688629 None] Lock "cinder-quobyte-8b7b909b-fc9a-488a-aae1-27d34ab3746b" released by "delete_volume" :: held 1.205s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:10 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-904b9b34-478c-43f6-a0fd-e36b67a8d216 tempest-VolumesGetTest-906688629 None] Created reservations ['99e17c97-317d-4ada-9989-4608e6d79a21', '224dfc64-deeb-4396-8a17-88ce30f48bc2', '6ace3057-8065-4fc7-a6c1-e779d3e59db5', '8761da59-1806-474b-9281-0f3070de7cc3'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:13:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-904b9b34-478c-43f6-a0fd-e36b67a8d216 tempest-VolumesGetTest-906688629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-904b9b34-478c-43f6-a0fd-e36b67a8d216 tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:10 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-904b9b34-478c-43f6-a0fd-e36b67a8d216 tempest-VolumesGetTest-906688629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:10 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-904b9b34-478c-43f6-a0fd-e36b67a8d216 tempest-VolumesGetTest-906688629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-904b9b34-478c-43f6-a0fd-e36b67a8d216 tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-904b9b34-478c-43f6-a0fd-e36b67a8d216 tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:10 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:13:10 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:10 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-dc44cef1-7e1e-4f27-bc33-afe6d599f211" returned: 0 in 0.545s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] Lock "cinder-quobyte-dc44cef1-7e1e-4f27-bc33-afe6d599f211" released by "delete_volume" :: held 1.199s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:10 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] Created reservations ['ab3037fc-115a-4001-8c15-fb88c77b8896'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:13:10 devstack cinder-volume[81350]: WARNING cinder.quota [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-866343702 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-866343702, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:13:10 devstack cinder-volume[81350]: WARNING cinder.quota [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-866343702 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-866343702, it is now deprecated. Please use the default quota class for default quota. Apr 27 10:13:10 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] Created reservations ['0a7f7311-184b-4a69-9205-f0e4d43fe9ff', 'ae0cce61-5846-4236-a6b1-d7ccb74e3290', 'eef1fc86-29c4-47db-9da4-9d8d37274f1c', '8ee0e5d8-7863-487c-9e72-f71173538a89'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] Created reservations ['77593175-e9e2-42f7-a5c1-0e8cdc8b287a', '6e89bd44-9235-49de-a858-cf0b093bcfa4', '3157edd3-3306-4aa5-89fb-aaa4e72a113e', 'ac4d37c1-1345-4076-9a61-e6c80dddb9cd'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:13:11 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-904b9b34-478c-43f6-a0fd-e36b67a8d216 tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.585s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-904b9b34-478c-43f6-a0fd-e36b67a8d216 tempest-VolumesGetTest-906688629 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:13:11 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-904b9b34-478c-43f6-a0fd-e36b67a8d216 tempest-VolumesGetTest-906688629 None] Deleted volume successfully. Apr 27 10:13:11 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:13:11 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-904b9b34-478c-43f6-a0fd-e36b67a8d216 tempest-VolumesGetTest-906688629 None] Lock "cinder-8b7b909b-fc9a-488a-aae1-27d34ab3746b-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Flow 'volume_create_manager' (8d48c7f1-c551-44bb-aea6-7fd8b43915ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:11 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee0c649-0a43-4cf5-b9c8-72ba60ac7c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.590s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:13:11 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-8f7ea111-1d27-4c84-ab9f-4d68d26a57d1 tempest-GroupsTest-1457143907 None] Delete group completed successfully. Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee0c649-0a43-4cf5-b9c8-72ba60ac7c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-308674244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93af20cc-9751-44bc-80ca-1307cbdc3aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4dee690a7fd41d3a3007b43cdb8d744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:12Z,use_quota=True,user_id='cfb2332f34f14f5187bd058c590656e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6f3d5e-e333-43cc-bb12-b458e8343411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6f3d5e-e333-43cc-bb12-b458e8343411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dced0a1-9cca-4a1e-bd10-4f8572d6dd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dced0a1-9cca-4a1e-bd10-4f8572d6dd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93af20cc-9751-44bc-80ca-1307cbdc3aed', 'volume_name': 'volume-93af20cc-9751-44bc-80ca-1307cbdc3aed', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (338b60f7-1561-4e94-8177-676f34fb57c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (338b60f7-1561-4e94-8177-676f34fb57c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (154ebac8-78fb-4142-9aec-36111deb0668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:11 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Volume 93af20cc-9751-44bc-80ca-1307cbdc3aed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93af20cc-9751-44bc-80ca-1307cbdc3aed', 'volume_size': 1} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-308674244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93af20cc-9751-44bc-80ca-1307cbdc3aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4dee690a7fd41d3a3007b43cdb8d744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:12Z,use_quota=True,user_id='cfb2332f34f14f5187bd058c590656e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Creating volume 93af20cc-9751-44bc-80ca-1307cbdc3aed {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:13:11 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:13:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:11 devstack sudo[88821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed 1073741824 Apr 27 10:13:11 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:12 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed 1073741824" returned: 0 in 0.667s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:12 devstack sudo[88826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed Apr 27 10:13:12 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:13 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed" returned: 0 in 0.478s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:13 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:13:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (154ebac8-78fb-4142-9aec-36111deb0668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93af20cc-9751-44bc-80ca-1307cbdc3aed', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43ccfcd-3d5c-426a-a91a-c09bd727cda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:13 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Volume volume-93af20cc-9751-44bc-80ca-1307cbdc3aed (93af20cc-9751-44bc-80ca-1307cbdc3aed): created successfully Apr 27 10:13:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43ccfcd-3d5c-426a-a91a-c09bd727cda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Flow 'volume_create_manager' (8d48c7f1-c551-44bb-aea6-7fd8b43915ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:13 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-138d999d-9c7b-4423-9fa4-f93d812776fc tempest-VolumesGetTest-906688629 None] Created volume successfully. Apr 27 10:13:14 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:13:14 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Flow 'volume_create_manager' (05fe7281-1f99-43d2-90a5-a8eec36c4c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:14 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d36a61-eb4b-49d3-8f49-4381140b81bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:14 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d36a61-eb4b-49d3-8f49-4381140b81bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-718727432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fef80c9-968b-46cc-8459-36e6f174db08,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a4dee690a7fd41d3a3007b43cdb8d744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=93af20cc-9751-44bc-80ca-1307cbdc3aed,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:14Z,use_quota=True,user_id='cfb2332f34f14f5187bd058c590656e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:14 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1fea91-c911-4638-977c-bb5f20f615e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:14 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1fea91-c911-4638-977c-bb5f20f615e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:14 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a110242-0983-4a10-bdce-f61cca4bd942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:14 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a110242-0983-4a10-bdce-f61cca4bd942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5fef80c9-968b-46cc-8459-36e6f174db08', 'volume_name': 'volume-5fef80c9-968b-46cc-8459-36e6f174db08', 'volume_size': 1, 'source_volid': '93af20cc-9751-44bc-80ca-1307cbdc3aed', 'source_volstatus': 'available'}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:14 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb8393d-c1f3-4fea-8922-54071160d0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:14 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb8393d-c1f3-4fea-8922-54071160d0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:14 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d2ab55-d3ed-48ff-9c3e-93dab393b779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:14 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Volume 5fef80c9-968b-46cc-8459-36e6f174db08: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5fef80c9-968b-46cc-8459-36e6f174db08', 'volume_size': 1, 'source_volid': '93af20cc-9751-44bc-80ca-1307cbdc3aed', 'source_volstatus': 'available'} Apr 27 10:13:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:14 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Cloning volume 93af20cc-9751-44bc-80ca-1307cbdc3aed to volume 5fef80c9-968b-46cc-8459-36e6f174db08 Apr 27 10:13:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Creating offline snapshot b9362351-6f56-45f8-9b25-5b55b7234987 of volume 93af20cc-9751-44bc-80ca-1307cbdc3aed {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:13:14 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf8280e-ae15-4356-9915-a4ebb5b7cb54]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:14 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed Apr 27 10:13:14 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:14 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed" returned: 0 in 0.567s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.b9362351-6f56-45f8-9b25-5b55b7234987 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:14 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.b9362351-6f56-45f8-9b25-5b55b7234987 1G Apr 27 10:13:14 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:15 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.b9362351-6f56-45f8-9b25-5b55b7234987 1G" returned: 0 in 0.656s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93af20cc-9751-44bc-80ca-1307cbdc3aed -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.b9362351-6f56-45f8-9b25-5b55b7234987 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:15 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93af20cc-9751-44bc-80ca-1307cbdc3aed -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.b9362351-6f56-45f8-9b25-5b55b7234987 Apr 27 10:13:15 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:16 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93af20cc-9751-44bc-80ca-1307cbdc3aed -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.b9362351-6f56-45f8-9b25-5b55b7234987" returned: 0 in 0.532s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:16 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.b9362351-6f56-45f8-9b25-5b55b7234987 is being set with open permissions: ugo+rw Apr 27 10:13:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.b9362351-6f56-45f8-9b25-5b55b7234987 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:16 devstack sudo[88851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.b9362351-6f56-45f8-9b25-5b55b7234987 Apr 27 10:13:16 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:16 devstack cinder-volume[81350]: DEBUG oslo_service.periodic_task [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81350) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 10:13:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:16 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.b9362351-6f56-45f8-9b25-5b55b7234987" returned: 0 in 0.496s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:16 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:13:16 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:16 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.info Apr 27 10:13:16 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:17 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.451s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:17 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:13:17 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.info" returned: 0 in 0.440s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:17 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.info is being set with open permissions: ugo+rw Apr 27 10:13:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:17 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.info Apr 27 10:13:17 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:17 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.info" returned: 0 in 0.441s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:17 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Acquiring lock "cinder-quobyte-5fef80c9-968b-46cc-8459-36e6f174db08" by "_copy_volume_from_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:17 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Lock "cinder-quobyte-5fef80c9-968b-46cc-8459-36e6f174db08" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:17 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] snapshot: b9362351-6f56-45f8-9b25-5b55b7234987, volume: 5fef80c9-968b-46cc-8459-36e6f174db08, {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 27 10:13:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:17 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:17 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:17 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24b1816-4471-4084-be3f-25bcf199b24f]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.b9362351-6f56-45f8-9b25-5b55b7234987 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:17 devstack sudo[88863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.b9362351-6f56-45f8-9b25-5b55b7234987 Apr 27 10:13:17 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:18 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.b9362351-6f56-45f8-9b25-5b55b7234987" returned: 0 in 0.533s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:18 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93af20cc-9751-44bc-80ca-1307cbdc3aed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:13:18 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 27 10:13:18 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Creating direct copy from snapshot {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 27 10:13:18 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[381151c2-f7b9-4399-aff0-b5b73d0168b8]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:18 devstack sudo[88868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed Apr 27 10:13:18 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:18 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed" returned: 0 in 0.547s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:18 devstack cinder-volume[81350]: DEBUG cinder.utils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Path /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5fef80c9-968b-46cc-8459-36e6f174db08 not found in is_blk_device check {{(pid=81350) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 27 10:13:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5fef80c9-968b-46cc-8459-36e6f174db08 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:18 devstack sudo[88873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5fef80c9-968b-46cc-8459-36e6f174db08 Apr 27 10:13:18 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:23 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5fef80c9-968b-46cc-8459-36e6f174db08" returned: 0 in 5.098s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:23 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9757d099-faa3-400c-acb7-6137caf9f170]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:23 devstack sudo[88885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed Apr 27 10:13:23 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:24 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed" returned: 0 in 0.738s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:24 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Image conversion details: src /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed, size 1024.00 MB, duration 5.10 sec, destination /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5fef80c9-968b-46cc-8459-36e6f174db08 {{(pid=81350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 10:13:24 devstack cinder-volume[81350]: INFO cinder.image.image_utils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Converted 1024.00 MB image at 200.82 MB/s Apr 27 10:13:24 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5fef80c9-968b-46cc-8459-36e6f174db08 is being set with open permissions: ugo+rw Apr 27 10:13:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5fef80c9-968b-46cc-8459-36e6f174db08 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:24 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5fef80c9-968b-46cc-8459-36e6f174db08 Apr 27 10:13:24 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:25 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5fef80c9-968b-46cc-8459-36e6f174db08" returned: 0 in 0.462s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:25 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Lock "cinder-quobyte-5fef80c9-968b-46cc-8459-36e6f174db08" released by "_copy_volume_from_snapshot" :: held 7.468s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:25 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Acquiring lock "cinder-quobyte-b9362351-6f56-45f8-9b25-5b55b7234987" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:25 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Lock "cinder-quobyte-b9362351-6f56-45f8-9b25-5b55b7234987" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:25 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Deleting offline snapshot b9362351-6f56-45f8-9b25-5b55b7234987 of volume 93af20cc-9751-44bc-80ca-1307cbdc3aed {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:13:25 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] snapshot_file for this snap is: volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.b9362351-6f56-45f8-9b25-5b55b7234987 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:13:25 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[253d9751-92ba-4ebf-b884-ae3d899b4321]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.b9362351-6f56-45f8-9b25-5b55b7234987 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:25 devstack sudo[88894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.b9362351-6f56-45f8-9b25-5b55b7234987 Apr 27 10:13:25 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:25 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.b9362351-6f56-45f8-9b25-5b55b7234987" returned: 0 in 0.570s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:25 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93af20cc-9751-44bc-80ca-1307cbdc3aed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:13:25 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be3db78-ee9c-4aec-94d3-644c08e7a35b]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:25 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed Apr 27 10:13:25 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:26 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed" returned: 0 in 0.599s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.b9362351-6f56-45f8-9b25-5b55b7234987 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:26 devstack sudo[88904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.b9362351-6f56-45f8-9b25-5b55b7234987 Apr 27 10:13:26 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:26 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:SELECT=119,cinder:INSERT=31,cinder:UPDATE=134,cinder:DELETE=10 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:13:26 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.b9362351-6f56-45f8-9b25-5b55b7234987" returned: 0 in 0.584s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.b9362351-6f56-45f8-9b25-5b55b7234987 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:26 devstack sudo[88909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.b9362351-6f56-45f8-9b25-5b55b7234987 Apr 27 10:13:26 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:27 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed.b9362351-6f56-45f8-9b25-5b55b7234987" returned: 0 in 0.476s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Lock "cinder-quobyte-b9362351-6f56-45f8-9b25-5b55b7234987" released by "_delete_snapshot" :: held 2.333s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.119s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d2ab55-d3ed-48ff-9c3e-93dab393b779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fef80c9-968b-46cc-8459-36e6f174db08', 'volume_size': 1, 'source_volid': '93af20cc-9751-44bc-80ca-1307cbdc3aed', 'source_volstatus': 'available'}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c1d1ea-1653-4f81-ac50-9014b3e211ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:27 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Volume volume-5fef80c9-968b-46cc-8459-36e6f174db08 (5fef80c9-968b-46cc-8459-36e6f174db08): created successfully Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c1d1ea-1653-4f81-ac50-9014b3e211ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Flow 'volume_create_manager' (05fe7281-1f99-43d2-90a5-a8eec36c4c26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:27 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-ccf759ac-06bb-4522-a184-4f2832af562e tempest-VolumesGetTest-906688629 None] Created volume successfully. Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Flow 'volume_create_manager' (eb74fef8-a46a-4b06-b20d-9ec0d3d19e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc575b4a-7f30-41dd-b1cd-5840372312e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc575b4a-7f30-41dd-b1cd-5840372312e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1156216045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4756516d-d8be-44de-8eb9-00cf384c1be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38fe0c671234b01af86ce8589ea8e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:28Z,use_quota=True,user_id='f5ae0af749054502b9095b328a09728c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e3429a-01af-467e-a824-cc41287ec18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e3429a-01af-467e-a824-cc41287ec18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b5bdee-0a2a-4c9e-990a-62481c86b0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b5bdee-0a2a-4c9e-990a-62481c86b0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4756516d-d8be-44de-8eb9-00cf384c1be8', 'volume_name': 'volume-4756516d-d8be-44de-8eb9-00cf384c1be8', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc3d793-05af-4689-91f8-e0c572245f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc3d793-05af-4689-91f8-e0c572245f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb1cd06-811a-48b3-a9ae-fedc9315891c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:27 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Volume 4756516d-d8be-44de-8eb9-00cf384c1be8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4756516d-d8be-44de-8eb9-00cf384c1be8', 'volume_size': 1} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1156216045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4756516d-d8be-44de-8eb9-00cf384c1be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38fe0c671234b01af86ce8589ea8e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:28Z,use_quota=True,user_id='f5ae0af749054502b9095b328a09728c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Creating volume 4756516d-d8be-44de-8eb9-00cf384c1be8 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:13:27 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:13:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4756516d-d8be-44de-8eb9-00cf384c1be8 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:27 devstack sudo[88912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4756516d-d8be-44de-8eb9-00cf384c1be8 1073741824 Apr 27 10:13:27 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:28 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4756516d-d8be-44de-8eb9-00cf384c1be8 1073741824" returned: 0 in 0.617s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4756516d-d8be-44de-8eb9-00cf384c1be8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:28 devstack sudo[88917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4756516d-d8be-44de-8eb9-00cf384c1be8 Apr 27 10:13:28 devstack sudo[88917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:28 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:13:28 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Flow 'volume_create_manager' (a5ece826-aeb5-411d-b1db-4ce82971597a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:28 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280083df-d875-499b-a9f3-c63624e06299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:28 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280083df-d875-499b-a9f3-c63624e06299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:13:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-504261030',display_name='tempest-VolumesGetTest-Volume-369462663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cb87f17-5dad-45ce-af0c-d9adb3c6eba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4dee690a7fd41d3a3007b43cdb8d744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:29Z,use_quota=True,user_id='cfb2332f34f14f5187bd058c590656e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:28 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91af68fd-ee07-4496-9f3c-a1cefe2571bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:28 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91af68fd-ee07-4496-9f3c-a1cefe2571bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:28 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799d6eba-84b5-4466-a0c8-086e9699cef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:28 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799d6eba-84b5-4466-a0c8-086e9699cef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cb87f17-5dad-45ce-af0c-d9adb3c6eba7', 'volume_name': 'volume-6cb87f17-5dad-45ce-af0c-d9adb3c6eba7', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:28 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599ae03a-d76f-4090-a1d5-7d327b803c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:28 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599ae03a-d76f-4090-a1d5-7d327b803c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:28 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd90a8f-77b7-40f7-a11f-54291e95b561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:28 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Volume 6cb87f17-5dad-45ce-af0c-d9adb3c6eba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cb87f17-5dad-45ce-af0c-d9adb3c6eba7', 'volume_size': 1} Apr 27 10:13:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:29 devstack sudo[88917]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4756516d-d8be-44de-8eb9-00cf384c1be8" returned: 0 in 0.496s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:29 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:13:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.168s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:29 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:13:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-504261030',display_name='tempest-VolumesGetTest-Volume-369462663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cb87f17-5dad-45ce-af0c-d9adb3c6eba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4dee690a7fd41d3a3007b43cdb8d744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:29Z,use_quota=True,user_id='cfb2332f34f14f5187bd058c590656e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:13:29 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Creating volume 6cb87f17-5dad-45ce-af0c-d9adb3c6eba7 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:13:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:29 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:29 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:29 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:13:29 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:13:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cb87f17-5dad-45ce-af0c-d9adb3c6eba7 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb1cd06-811a-48b3-a9ae-fedc9315891c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4756516d-d8be-44de-8eb9-00cf384c1be8', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:29 devstack sudo[88920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cb87f17-5dad-45ce-af0c-d9adb3c6eba7 1073741824 Apr 27 10:13:29 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112d41a1-c7d2-4294-b1b3-72220ed89506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:29 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Volume volume-4756516d-d8be-44de-8eb9-00cf384c1be8 (4756516d-d8be-44de-8eb9-00cf384c1be8): created successfully Apr 27 10:13:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112d41a1-c7d2-4294-b1b3-72220ed89506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Flow 'volume_create_manager' (eb74fef8-a46a-4b06-b20d-9ec0d3d19e96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:29 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-b42c6c9b-fd3b-4d87-a933-aa7730d5c9a8 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Created volume successfully. Apr 27 10:13:29 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cb87f17-5dad-45ce-af0c-d9adb3c6eba7 1073741824" returned: 0 in 0.596s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cb87f17-5dad-45ce-af0c-d9adb3c6eba7 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:29 devstack sudo[88925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cb87f17-5dad-45ce-af0c-d9adb3c6eba7 Apr 27 10:13:29 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e6639068-a930-4e2a-a15b-f1b87fc35d75 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Acquiring lock "cinder-4756516d-d8be-44de-8eb9-00cf384c1be8-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e6639068-a930-4e2a-a15b-f1b87fc35d75 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Lock "cinder-4756516d-d8be-44de-8eb9-00cf384c1be8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e6639068-a930-4e2a-a15b-f1b87fc35d75 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Acquiring lock "cinder-quobyte-4756516d-d8be-44de-8eb9-00cf384c1be8" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e6639068-a930-4e2a-a15b-f1b87fc35d75 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Lock "cinder-quobyte-4756516d-d8be-44de-8eb9-00cf384c1be8" acquired by "delete_volume" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:30 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66e8223-cd40-49ed-abe9-3370abf1fc20]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e6639068-a930-4e2a-a15b-f1b87fc35d75 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4756516d-d8be-44de-8eb9-00cf384c1be8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:30 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cb87f17-5dad-45ce-af0c-d9adb3c6eba7" returned: 0 in 0.494s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:30 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:13:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:30 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd90a8f-77b7-40f7-a11f-54291e95b561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cb87f17-5dad-45ce-af0c-d9adb3c6eba7', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:30 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d05f85-9cfa-4a65-80d9-9c568efe355e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:30 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Volume volume-6cb87f17-5dad-45ce-af0c-d9adb3c6eba7 (6cb87f17-5dad-45ce-af0c-d9adb3c6eba7): created successfully Apr 27 10:13:30 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d05f85-9cfa-4a65-80d9-9c568efe355e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:30 devstack sudo[88928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4756516d-d8be-44de-8eb9-00cf384c1be8 Apr 27 10:13:30 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:30 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Flow 'volume_create_manager' (a5ece826-aeb5-411d-b1db-4ce82971597a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:30 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-3d34a006-b1a4-4065-b139-80bb1ae07786 tempest-VolumesGetTest-906688629 None] Created volume successfully. Apr 27 10:13:30 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e6639068-a930-4e2a-a15b-f1b87fc35d75 tempest-VolumeQuotasAdminTestJSON-1630797558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4756516d-d8be-44de-8eb9-00cf384c1be8" returned: 0 in 0.531s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e6639068-a930-4e2a-a15b-f1b87fc35d75 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4756516d-d8be-44de-8eb9-00cf384c1be8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:30 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4756516d-d8be-44de-8eb9-00cf384c1be8 Apr 27 10:13:30 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-44c15960-e9ea-4ee9-8090-b9cdd98fc33d tempest-VolumesGetTest-906688629 None] Acquiring lock "cinder-6cb87f17-5dad-45ce-af0c-d9adb3c6eba7-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-44c15960-e9ea-4ee9-8090-b9cdd98fc33d tempest-VolumesGetTest-906688629 None] Lock "cinder-6cb87f17-5dad-45ce-af0c-d9adb3c6eba7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-44c15960-e9ea-4ee9-8090-b9cdd98fc33d tempest-VolumesGetTest-906688629 None] Acquiring lock "cinder-quobyte-6cb87f17-5dad-45ce-af0c-d9adb3c6eba7" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:31 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-44c15960-e9ea-4ee9-8090-b9cdd98fc33d tempest-VolumesGetTest-906688629 None] Lock "cinder-quobyte-6cb87f17-5dad-45ce-af0c-d9adb3c6eba7" acquired by "delete_volume" :: waited 0.021s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e6639068-a930-4e2a-a15b-f1b87fc35d75 tempest-VolumeQuotasAdminTestJSON-1630797558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4756516d-d8be-44de-8eb9-00cf384c1be8" returned: 0 in 0.517s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:31 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d18cc6-3b3f-4918-93bf-4e7d74b2cee0]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-44c15960-e9ea-4ee9-8090-b9cdd98fc33d tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cb87f17-5dad-45ce-af0c-d9adb3c6eba7 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e6639068-a930-4e2a-a15b-f1b87fc35d75 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Lock "cinder-quobyte-4756516d-d8be-44de-8eb9-00cf384c1be8" released by "delete_volume" :: held 1.098s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:31 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-e6639068-a930-4e2a-a15b-f1b87fc35d75 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Created reservations ['a0cc27a7-3609-49d2-bccc-7e1f75bb3019', 'ae3ef20e-7721-4213-afdc-8c32b3b0acb7', '755b52ed-6ddc-4b2a-98e8-a2ec23f21984', '0c421f6c-83e3-4d57-8258-387ceb790d47'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:13:31 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cb87f17-5dad-45ce-af0c-d9adb3c6eba7 Apr 27 10:13:31 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e6639068-a930-4e2a-a15b-f1b87fc35d75 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e6639068-a930-4e2a-a15b-f1b87fc35d75 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:31 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e6639068-a930-4e2a-a15b-f1b87fc35d75 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:31 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e6639068-a930-4e2a-a15b-f1b87fc35d75 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e6639068-a930-4e2a-a15b-f1b87fc35d75 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e6639068-a930-4e2a-a15b-f1b87fc35d75 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:31 devstack sudo[88940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:13:31 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:31 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-44c15960-e9ea-4ee9-8090-b9cdd98fc33d tempest-VolumesGetTest-906688629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cb87f17-5dad-45ce-af0c-d9adb3c6eba7" returned: 0 in 0.520s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-44c15960-e9ea-4ee9-8090-b9cdd98fc33d tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cb87f17-5dad-45ce-af0c-d9adb3c6eba7 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:31 devstack sudo[88946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cb87f17-5dad-45ce-af0c-d9adb3c6eba7 Apr 27 10:13:31 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:31 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e6639068-a930-4e2a-a15b-f1b87fc35d75 tempest-VolumeQuotasAdminTestJSON-1630797558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.463s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:31 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-e6639068-a930-4e2a-a15b-f1b87fc35d75 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:13:31 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-e6639068-a930-4e2a-a15b-f1b87fc35d75 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Deleted volume successfully. Apr 27 10:13:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e6639068-a930-4e2a-a15b-f1b87fc35d75 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Lock "cinder-4756516d-d8be-44de-8eb9-00cf384c1be8-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:32 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-44c15960-e9ea-4ee9-8090-b9cdd98fc33d tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6cb87f17-5dad-45ce-af0c-d9adb3c6eba7" returned: 0 in 0.451s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-44c15960-e9ea-4ee9-8090-b9cdd98fc33d tempest-VolumesGetTest-906688629 None] Lock "cinder-quobyte-6cb87f17-5dad-45ce-af0c-d9adb3c6eba7" released by "delete_volume" :: held 1.014s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-44c15960-e9ea-4ee9-8090-b9cdd98fc33d tempest-VolumesGetTest-906688629 None] Created reservations ['3d552a4b-ebf2-40cb-8227-fd8d604eaa26', '34c2c598-a1a2-41f8-a8f3-5f02e855aeb5', 'd8b768d7-26e6-4eeb-bdf0-a18d07b030cb', 'b01ff41d-9898-4a67-b217-e29c278b97ee'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-44c15960-e9ea-4ee9-8090-b9cdd98fc33d tempest-VolumesGetTest-906688629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-44c15960-e9ea-4ee9-8090-b9cdd98fc33d tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-44c15960-e9ea-4ee9-8090-b9cdd98fc33d tempest-VolumesGetTest-906688629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-44c15960-e9ea-4ee9-8090-b9cdd98fc33d tempest-VolumesGetTest-906688629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-44c15960-e9ea-4ee9-8090-b9cdd98fc33d tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-44c15960-e9ea-4ee9-8090-b9cdd98fc33d tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:32 devstack sudo[88949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:13:32 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Flow 'volume_create_manager' (42a02ea5-b856-4cb8-9965-985e0e155a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59995b3-c72b-4aa3-9825-cef40a00a2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59995b3-c72b-4aa3-9825-cef40a00a2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-215896470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c0e4b3b-1296-4609-90c9-7d904f2cccf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38fe0c671234b01af86ce8589ea8e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:33Z,use_quota=True,user_id='f5ae0af749054502b9095b328a09728c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf83076d-d0cc-4412-a962-ca9469c09121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf83076d-d0cc-4412-a962-ca9469c09121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1947668e-d5e7-4786-8808-db02c30d0b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1947668e-d5e7-4786-8808-db02c30d0b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c0e4b3b-1296-4609-90c9-7d904f2cccf4', 'volume_name': 'volume-5c0e4b3b-1296-4609-90c9-7d904f2cccf4', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b97590-58e0-4916-b387-e345c90a2c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b97590-58e0-4916-b387-e345c90a2c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b905048-5ebd-420f-9711-1fa7106c1aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:32 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Volume 5c0e4b3b-1296-4609-90c9-7d904f2cccf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c0e4b3b-1296-4609-90c9-7d904f2cccf4', 'volume_size': 1} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-215896470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c0e4b3b-1296-4609-90c9-7d904f2cccf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38fe0c671234b01af86ce8589ea8e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:33Z,use_quota=True,user_id='f5ae0af749054502b9095b328a09728c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Creating volume 5c0e4b3b-1296-4609-90c9-7d904f2cccf4 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:13:32 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5c0e4b3b-1296-4609-90c9-7d904f2cccf4 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:32 devstack sudo[88952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5c0e4b3b-1296-4609-90c9-7d904f2cccf4 1073741824 Apr 27 10:13:32 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:32 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-44c15960-e9ea-4ee9-8090-b9cdd98fc33d tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.468s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-44c15960-e9ea-4ee9-8090-b9cdd98fc33d tempest-VolumesGetTest-906688629 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:13:32 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-44c15960-e9ea-4ee9-8090-b9cdd98fc33d tempest-VolumesGetTest-906688629 None] Deleted volume successfully. Apr 27 10:13:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-44c15960-e9ea-4ee9-8090-b9cdd98fc33d tempest-VolumesGetTest-906688629 None] Lock "cinder-6cb87f17-5dad-45ce-af0c-d9adb3c6eba7-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:33 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5c0e4b3b-1296-4609-90c9-7d904f2cccf4 1073741824" returned: 0 in 0.605s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5c0e4b3b-1296-4609-90c9-7d904f2cccf4 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:33 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5c0e4b3b-1296-4609-90c9-7d904f2cccf4 Apr 27 10:13:33 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:33 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ce661410-603f-433f-8898-9f2bb245b0e1 tempest-VolumesGetTest-906688629 None] Acquiring lock "cinder-5fef80c9-968b-46cc-8459-36e6f174db08-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:33 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ce661410-603f-433f-8898-9f2bb245b0e1 tempest-VolumesGetTest-906688629 None] Lock "cinder-5fef80c9-968b-46cc-8459-36e6f174db08-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:33 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ce661410-603f-433f-8898-9f2bb245b0e1 tempest-VolumesGetTest-906688629 None] Acquiring lock "cinder-quobyte-5fef80c9-968b-46cc-8459-36e6f174db08" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:33 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ce661410-603f-433f-8898-9f2bb245b0e1 tempest-VolumesGetTest-906688629 None] Lock "cinder-quobyte-5fef80c9-968b-46cc-8459-36e6f174db08" acquired by "delete_volume" :: waited 0.015s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:33 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[811f5865-02a9-4dd9-9ebf-fb6849a5e11a]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ce661410-603f-433f-8898-9f2bb245b0e1 tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5fef80c9-968b-46cc-8459-36e6f174db08 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:33 devstack sudo[88959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5fef80c9-968b-46cc-8459-36e6f174db08 Apr 27 10:13:33 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:33 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5c0e4b3b-1296-4609-90c9-7d904f2cccf4" returned: 0 in 0.506s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:33 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:13:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:33 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:SELECT=153,cinder:INSERT=51,cinder:UPDATE=206,cinder:DELETE=11 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:13:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b905048-5ebd-420f-9711-1fa7106c1aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c0e4b3b-1296-4609-90c9-7d904f2cccf4', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb8a81e-6aab-4097-afb2-52de9179f394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:33 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Volume volume-5c0e4b3b-1296-4609-90c9-7d904f2cccf4 (5c0e4b3b-1296-4609-90c9-7d904f2cccf4): created successfully Apr 27 10:13:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb8a81e-6aab-4097-afb2-52de9179f394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Flow 'volume_create_manager' (42a02ea5-b856-4cb8-9965-985e0e155a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:33 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-ca0a6b10-faa6-4408-a1fd-b888e3b73cb5 tempest-VolumeQuotasAdminTestJSON-1630797558 None] Created volume successfully. Apr 27 10:13:34 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ce661410-603f-433f-8898-9f2bb245b0e1 tempest-VolumesGetTest-906688629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5fef80c9-968b-46cc-8459-36e6f174db08" returned: 0 in 0.552s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ce661410-603f-433f-8898-9f2bb245b0e1 tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5fef80c9-968b-46cc-8459-36e6f174db08 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:34 devstack sudo[88965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5fef80c9-968b-46cc-8459-36e6f174db08 Apr 27 10:13:34 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:34 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ce661410-603f-433f-8898-9f2bb245b0e1 tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5fef80c9-968b-46cc-8459-36e6f174db08" returned: 0 in 0.451s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:34 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ce661410-603f-433f-8898-9f2bb245b0e1 tempest-VolumesGetTest-906688629 None] Lock "cinder-quobyte-5fef80c9-968b-46cc-8459-36e6f174db08" released by "delete_volume" :: held 1.047s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:34 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-ce661410-603f-433f-8898-9f2bb245b0e1 tempest-VolumesGetTest-906688629 None] Created reservations ['d40e414b-d708-41b1-9b84-e440506080a3', '33aa6927-7cfa-4860-a13a-1dc8c8f6bdd2', '1678289f-f910-42e7-88e2-ececdd88870e', 'f41a6284-45cb-4002-a54e-644dc0420bc7'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:13:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ce661410-603f-433f-8898-9f2bb245b0e1 tempest-VolumesGetTest-906688629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ce661410-603f-433f-8898-9f2bb245b0e1 tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ce661410-603f-433f-8898-9f2bb245b0e1 tempest-VolumesGetTest-906688629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ce661410-603f-433f-8898-9f2bb245b0e1 tempest-VolumesGetTest-906688629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ce661410-603f-433f-8898-9f2bb245b0e1 tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ce661410-603f-433f-8898-9f2bb245b0e1 tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:34 devstack sudo[88969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:13:34 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:35 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ce661410-603f-433f-8898-9f2bb245b0e1 tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.470s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:35 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-ce661410-603f-433f-8898-9f2bb245b0e1 tempest-VolumesGetTest-906688629 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:13:35 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-ce661410-603f-433f-8898-9f2bb245b0e1 tempest-VolumesGetTest-906688629 None] Deleted volume successfully. Apr 27 10:13:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ce661410-603f-433f-8898-9f2bb245b0e1 tempest-VolumesGetTest-906688629 None] Lock "cinder-5fef80c9-968b-46cc-8459-36e6f174db08-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:35 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-b166a476-3160-49e4-93e8-89263c203f64 tempest-VolumeQuotasAdminTestJSON-1063186197 None] Transfer volume completed successfully. Apr 27 10:13:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-21276bb6-d718-4857-a69a-fb5cf8e38803 tempest-VolumesGetTest-906688629 None] Acquiring lock "cinder-93af20cc-9751-44bc-80ca-1307cbdc3aed-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-21276bb6-d718-4857-a69a-fb5cf8e38803 tempest-VolumesGetTest-906688629 None] Lock "cinder-93af20cc-9751-44bc-80ca-1307cbdc3aed-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-21276bb6-d718-4857-a69a-fb5cf8e38803 tempest-VolumesGetTest-906688629 None] Acquiring lock "cinder-quobyte-93af20cc-9751-44bc-80ca-1307cbdc3aed" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-21276bb6-d718-4857-a69a-fb5cf8e38803 tempest-VolumesGetTest-906688629 None] Lock "cinder-quobyte-93af20cc-9751-44bc-80ca-1307cbdc3aed" acquired by "delete_volume" :: waited 0.019s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:35 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa54be0c-f4ca-487c-b55f-14ff99498b71]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-21276bb6-d718-4857-a69a-fb5cf8e38803 tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:35 devstack sudo[88972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed Apr 27 10:13:35 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-af7522f5-4073-416d-8c5d-3ddb2444a128 tempest-VolumeQuotasAdminTestJSON-1807568041 None] Acquiring lock "cinder-5c0e4b3b-1296-4609-90c9-7d904f2cccf4-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-af7522f5-4073-416d-8c5d-3ddb2444a128 tempest-VolumeQuotasAdminTestJSON-1807568041 None] Lock "cinder-5c0e4b3b-1296-4609-90c9-7d904f2cccf4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-af7522f5-4073-416d-8c5d-3ddb2444a128 tempest-VolumeQuotasAdminTestJSON-1807568041 None] Acquiring lock "cinder-quobyte-5c0e4b3b-1296-4609-90c9-7d904f2cccf4" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-af7522f5-4073-416d-8c5d-3ddb2444a128 tempest-VolumeQuotasAdminTestJSON-1807568041 None] Lock "cinder-quobyte-5c0e4b3b-1296-4609-90c9-7d904f2cccf4" acquired by "delete_volume" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:36 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[237fc16b-1c17-4927-8ed9-50ee50116d37]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-af7522f5-4073-416d-8c5d-3ddb2444a128 tempest-VolumeQuotasAdminTestJSON-1807568041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5c0e4b3b-1296-4609-90c9-7d904f2cccf4 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:36 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-21276bb6-d718-4857-a69a-fb5cf8e38803 tempest-VolumesGetTest-906688629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed" returned: 0 in 0.574s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-21276bb6-d718-4857-a69a-fb5cf8e38803 tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:36 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5c0e4b3b-1296-4609-90c9-7d904f2cccf4 Apr 27 10:13:36 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:36 devstack sudo[88979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed Apr 27 10:13:36 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:36 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-af7522f5-4073-416d-8c5d-3ddb2444a128 tempest-VolumeQuotasAdminTestJSON-1807568041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5c0e4b3b-1296-4609-90c9-7d904f2cccf4" returned: 0 in 0.516s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-af7522f5-4073-416d-8c5d-3ddb2444a128 tempest-VolumeQuotasAdminTestJSON-1807568041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5c0e4b3b-1296-4609-90c9-7d904f2cccf4 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:36 devstack sudo[88985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5c0e4b3b-1296-4609-90c9-7d904f2cccf4 Apr 27 10:13:36 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:36 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-21276bb6-d718-4857-a69a-fb5cf8e38803 tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-93af20cc-9751-44bc-80ca-1307cbdc3aed" returned: 0 in 0.472s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-21276bb6-d718-4857-a69a-fb5cf8e38803 tempest-VolumesGetTest-906688629 None] Lock "cinder-quobyte-93af20cc-9751-44bc-80ca-1307cbdc3aed" released by "delete_volume" :: held 1.106s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:36 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-21276bb6-d718-4857-a69a-fb5cf8e38803 tempest-VolumesGetTest-906688629 None] Created reservations ['6f3021a4-4120-4ea7-85c0-20fc0a36833a', '358b5e9e-019a-4fe3-bb20-b9bc9dc3b19d', '2c8ace52-00bc-4c26-ba46-5b5a5921c26b', 'c7be6186-a3dc-44f9-87c7-eefe51f2efd7'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:13:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-21276bb6-d718-4857-a69a-fb5cf8e38803 tempest-VolumesGetTest-906688629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-21276bb6-d718-4857-a69a-fb5cf8e38803 tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:37 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-21276bb6-d718-4857-a69a-fb5cf8e38803 tempest-VolumesGetTest-906688629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:37 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-21276bb6-d718-4857-a69a-fb5cf8e38803 tempest-VolumesGetTest-906688629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-21276bb6-d718-4857-a69a-fb5cf8e38803 tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-21276bb6-d718-4857-a69a-fb5cf8e38803 tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:37 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:13:37 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:37 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-af7522f5-4073-416d-8c5d-3ddb2444a128 tempest-VolumeQuotasAdminTestJSON-1807568041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5c0e4b3b-1296-4609-90c9-7d904f2cccf4" returned: 0 in 0.438s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-af7522f5-4073-416d-8c5d-3ddb2444a128 tempest-VolumeQuotasAdminTestJSON-1807568041 None] Lock "cinder-quobyte-5c0e4b3b-1296-4609-90c9-7d904f2cccf4" released by "delete_volume" :: held 0.998s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:37 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-af7522f5-4073-416d-8c5d-3ddb2444a128 tempest-VolumeQuotasAdminTestJSON-1807568041 None] Created reservations ['928b6672-32c3-4ec7-8cb9-fe6baec15fbd', '4353e71c-84c0-47e7-8696-a64bed5fc9be', '00ea0c85-acf9-4012-82a4-eae29e622c80', '5e6fb637-31bf-4d93-8431-25ded4728556'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:13:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-af7522f5-4073-416d-8c5d-3ddb2444a128 tempest-VolumeQuotasAdminTestJSON-1807568041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-af7522f5-4073-416d-8c5d-3ddb2444a128 tempest-VolumeQuotasAdminTestJSON-1807568041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:37 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-af7522f5-4073-416d-8c5d-3ddb2444a128 tempest-VolumeQuotasAdminTestJSON-1807568041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:37 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-af7522f5-4073-416d-8c5d-3ddb2444a128 tempest-VolumeQuotasAdminTestJSON-1807568041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-af7522f5-4073-416d-8c5d-3ddb2444a128 tempest-VolumeQuotasAdminTestJSON-1807568041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-af7522f5-4073-416d-8c5d-3ddb2444a128 tempest-VolumeQuotasAdminTestJSON-1807568041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:37 devstack sudo[88991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:13:37 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:37 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-21276bb6-d718-4857-a69a-fb5cf8e38803 tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.472s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:37 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-21276bb6-d718-4857-a69a-fb5cf8e38803 tempest-VolumesGetTest-906688629 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:13:37 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-21276bb6-d718-4857-a69a-fb5cf8e38803 tempest-VolumesGetTest-906688629 None] Deleted volume successfully. Apr 27 10:13:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-21276bb6-d718-4857-a69a-fb5cf8e38803 tempest-VolumesGetTest-906688629 None] Lock "cinder-93af20cc-9751-44bc-80ca-1307cbdc3aed-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:37 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-af7522f5-4073-416d-8c5d-3ddb2444a128 tempest-VolumeQuotasAdminTestJSON-1807568041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.446s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:37 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-af7522f5-4073-416d-8c5d-3ddb2444a128 tempest-VolumeQuotasAdminTestJSON-1807568041 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:13:37 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-af7522f5-4073-416d-8c5d-3ddb2444a128 tempest-VolumeQuotasAdminTestJSON-1807568041 None] Deleted volume successfully. Apr 27 10:13:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-af7522f5-4073-416d-8c5d-3ddb2444a128 tempest-VolumeQuotasAdminTestJSON-1807568041 None] Lock "cinder-5c0e4b3b-1296-4609-90c9-7d904f2cccf4-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:38 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:13:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Flow 'volume_create_manager' (629c1d0a-a8dc-4e35-bab1-dfcf90c49b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cea379b-4c97-4f2f-81f4-665bac334fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cea379b-4c97-4f2f-81f4-665bac334fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1328886746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26128d0-c870-4818-a809-627c73a76bc1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a4dee690a7fd41d3a3007b43cdb8d744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:38Z,use_quota=True,user_id='cfb2332f34f14f5187bd058c590656e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cb54b7-8ab7-407a-8966-5d63d25ba4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cb54b7-8ab7-407a-8966-5d63d25ba4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2024622-e726-4f79-bcea-4228dec95244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:38 devstack cinder-volume[81350]: DEBUG cinder.image.glance [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Creating Keystone auth plugin from conf {{(pid=81350) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 27 10:13:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2024622-e726-4f79-bcea-4228dec95244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e26128d0-c870-4818-a809-627c73a76bc1', 'volume_name': 'volume-e26128d0-c870-4818-a809-627c73a76bc1', 'volume_size': 1, 'image_id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f81a6757fcfa47c099a3bbded3b529cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'created_at': datetime.datetime(2026, 4, 27, 7, 59, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 7, 59, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe51512e-e3b0-462c-b924-3fc57fe75236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe51512e-e3b0-462c-b924-3fc57fe75236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98cd33c0-7bea-481a-b404-f8c73fcc07c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:38 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Volume e26128d0-c870-4818-a809-627c73a76bc1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e26128d0-c870-4818-a809-627c73a76bc1', 'volume_size': 1, 'image_id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f81a6757fcfa47c099a3bbded3b529cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'created_at': datetime.datetime(2026, 4, 27, 7, 59, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 7, 59, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 27 10:13:38 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Trying to clone e26128d0-c870-4818-a809-627c73a76bc1 from image d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa at location (None, [{'url': 'file:///opt/stack/data/glance/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'metadata': {}}]). {{(pid=81350) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 27 10:13:39 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_j1zpg9d9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81350) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 27 10:13:39 devstack cinder-volume[81350]: INFO cinder.image.image_utils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Image download 20.69 MB at 20.69 MB/s Apr 27 10:13:39 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e995b9-93d2-48d1-83f7-40857bc197cf]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_j1zpg9d9devstack@QuobyteHD {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:39 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_j1zpg9d9devstack@QuobyteHD Apr 27 10:13:39 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:39 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_j1zpg9d9devstack@QuobyteHD" returned: 0 in 0.534s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:39 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Temporary image d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa is fetched for user cfb2332f34f14f5187bd058c590656e2. {{(pid=81350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 27 10:13:39 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[7403c9b3-e8bb-4249-9550-1ca7be3c4988]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_j1zpg9d9devstack@QuobyteHD {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:39 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_j1zpg9d9devstack@QuobyteHD Apr 27 10:13:39 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:40 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_j1zpg9d9devstack@QuobyteHD" returned: 0 in 0.531s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:40 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1328886746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26128d0-c870-4818-a809-627c73a76bc1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a4dee690a7fd41d3a3007b43cdb8d744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:38Z,use_quota=True,user_id='cfb2332f34f14f5187bd058c590656e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:13:40 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Creating volume e26128d0-c870-4818-a809-627c73a76bc1 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:13:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:40 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:40 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:40 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:13:40 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:13:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:40 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1 1073741824 Apr 27 10:13:40 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:41 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1 1073741824" returned: 0 in 0.692s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:41 devstack sudo[89010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1 Apr 27 10:13:41 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:41 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1" returned: 0 in 0.519s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:13:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:41 devstack cinder-volume[81350]: DEBUG cinder.volume.volume_utils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Attempting download of d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa ((None, [{'url': 'file:///opt/stack/data/glance/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'metadata': {}}])) to volume e26128d0-c870-4818-a809-627c73a76bc1. {{(pid=81350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 27 10:13:41 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[379e71c4-60ee-4c8a-8e42-c476963194af]: (4, 'raw') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_ftktztbw {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:41 devstack sudo[89013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_ftktztbw Apr 27 10:13:41 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:42 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_ftktztbw" returned: 0 in 0.546s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_ftktztbw {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:42 devstack sudo[89017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_ftktztbw Apr 27 10:13:42 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:42 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_ftktztbw" returned: 1 in 0.535s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_ftktztbw' failed. Not Retrying. {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 10:13:42 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a78118-1347-4823-8b15-7929be557f90]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_j1zpg9d9devstack@QuobyteHD {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:42 devstack sudo[89021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_j1zpg9d9devstack@QuobyteHD Apr 27 10:13:42 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:43 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_j1zpg9d9devstack@QuobyteHD" returned: 0 in 0.549s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:43 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa was qcow2, converting to raw {{(pid=81350) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 27 10:13:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_j1zpg9d9devstack@QuobyteHD /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:43 devstack sudo[89026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_j1zpg9d9devstack@QuobyteHD /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1 Apr 27 10:13:43 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Flow 'volume_create_manager' (8758b51b-3598-4661-bcd5-d3ad4856a7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d5bb58-ccef-4526-b58b-bd3325db900e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d5bb58-ccef-4526-b58b-bd3325db900e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1591637312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89990f2-4358-4407-98ef-1a055f96eb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f79eabf6db4ee593230a0702909cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:45Z,use_quota=True,user_id='718b32d56398458fa09d8f8703f7c289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fbea54-7892-47f0-8a1b-b980d5facd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fbea54-7892-47f0-8a1b-b980d5facd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5c619b-3a34-4c14-a166-23b85d22fab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5c619b-3a34-4c14-a166-23b85d22fab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c89990f2-4358-4407-98ef-1a055f96eb67', 'volume_name': 'volume-c89990f2-4358-4407-98ef-1a055f96eb67', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (394cc1e3-e337-489d-95df-8311fbdbf576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (394cc1e3-e337-489d-95df-8311fbdbf576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f84c6e5-ba92-4ee7-a839-628756edaf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:44 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Volume c89990f2-4358-4407-98ef-1a055f96eb67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c89990f2-4358-4407-98ef-1a055f96eb67', 'volume_size': 1} Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1591637312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89990f2-4358-4407-98ef-1a055f96eb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f79eabf6db4ee593230a0702909cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:45Z,use_quota=True,user_id='718b32d56398458fa09d8f8703f7c289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Creating volume c89990f2-4358-4407-98ef-1a055f96eb67 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:13:44 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:13:44 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c89990f2-4358-4407-98ef-1a055f96eb67 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_j1zpg9d9devstack@QuobyteHD /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1" returned: 0 in 1.434s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_j1zpg9d9devstack@QuobyteHD, size 112.00 MB, duration 1.44 sec, destination /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1 {{(pid=81350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 10:13:44 devstack cinder-volume[81350]: INFO cinder.image.image_utils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Converted 112.00 MB image at 78.00 MB/s Apr 27 10:13:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:44 devstack sudo[89037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c89990f2-4358-4407-98ef-1a055f96eb67 1073741824 Apr 27 10:13:44 devstack sudo[89037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:44 devstack sudo[89038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1 1G Apr 27 10:13:44 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:45 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1 1G" returned: 0 in 0.479s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:45 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a0378f-962a-4428-8c8b-a69c87e0d9d8]: (4, 'raw') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:45 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1 Apr 27 10:13:45 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:45 devstack sudo[89037]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c89990f2-4358-4407-98ef-1a055f96eb67 1073741824" returned: 0 in 0.639s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c89990f2-4358-4407-98ef-1a055f96eb67 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:45 devstack sudo[89049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c89990f2-4358-4407-98ef-1a055f96eb67 Apr 27 10:13:45 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:45 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1" returned: 0 in 0.556s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:45 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c89990f2-4358-4407-98ef-1a055f96eb67" returned: 0 in 0.459s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:45 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:13:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:45 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f84c6e5-ba92-4ee7-a839-628756edaf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c89990f2-4358-4407-98ef-1a055f96eb67', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:45 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1 Apr 27 10:13:45 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:45 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e59b94f-ebff-43ae-a0d6-d9533889adac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:45 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Volume volume-c89990f2-4358-4407-98ef-1a055f96eb67 (c89990f2-4358-4407-98ef-1a055f96eb67): created successfully Apr 27 10:13:45 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e59b94f-ebff-43ae-a0d6-d9533889adac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:45 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Flow 'volume_create_manager' (8758b51b-3598-4661-bcd5-d3ad4856a7f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:45 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-1bde10ac-5c27-41a7-a26f-c9b355d1ff7d tempest-VolumesServicesTestJSON-872370903 None] Created volume successfully. Apr 27 10:13:46 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1" returned: 1 in 0.488s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1' failed. Not Retrying. {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 10:13:46 devstack cinder-volume[81350]: DEBUG cinder.volume.volume_utils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Downloaded image d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa ((None, [{'url': 'file:///opt/stack/data/glance/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'metadata': {}}])) to volume e26128d0-c870-4818-a809-627c73a76bc1 successfully. {{(pid=81350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 27 10:13:46 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Temporary image d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa for user cfb2332f34f14f5187bd058c590656e2 is deleted. {{(pid=81350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 27 10:13:46 devstack cinder-volume[81350]: DEBUG cinder.volume.volume_utils [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Marking volume e26128d0-c870-4818-a809-627c73a76bc1 as bootable. {{(pid=81350) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 27 10:13:46 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Copying metadata from image d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa to e26128d0-c870-4818-a809-627c73a76bc1. {{(pid=81350) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 27 10:13:46 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Creating volume glance metadata for volume e26128d0-c870-4818-a809-627c73a76bc1 backed by image d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81350) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 27 10:13:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98cd33c0-7bea-481a-b404-f8c73fcc07c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e26128d0-c870-4818-a809-627c73a76bc1', 'volume_size': 1, 'image_id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f81a6757fcfa47c099a3bbded3b529cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'created_at': datetime.datetime(2026, 4, 27, 7, 59, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 7, 59, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03beed90-af2e-4066-9e14-d2abd0a8cdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:46 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Volume volume-e26128d0-c870-4818-a809-627c73a76bc1 (e26128d0-c870-4818-a809-627c73a76bc1): created successfully Apr 27 10:13:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03beed90-af2e-4066-9e14-d2abd0a8cdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:46 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Flow 'volume_create_manager' (629c1d0a-a8dc-4e35-bab1-dfcf90c49b50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:46 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-0edc637f-b8b7-4055-9059-1cb437c77c2b tempest-VolumesGetTest-906688629 None] Created volume successfully. Apr 27 10:13:46 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-6be03f70-9419-4188-b7ae-d2a88c5de16a tempest-VolumesServicesTestJSON-872370903 None] Acquiring lock "cinder-c89990f2-4358-4407-98ef-1a055f96eb67-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:46 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-6be03f70-9419-4188-b7ae-d2a88c5de16a tempest-VolumesServicesTestJSON-872370903 None] Lock "cinder-c89990f2-4358-4407-98ef-1a055f96eb67-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:46 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-6be03f70-9419-4188-b7ae-d2a88c5de16a tempest-VolumesServicesTestJSON-872370903 None] Acquiring lock "cinder-quobyte-c89990f2-4358-4407-98ef-1a055f96eb67" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-6be03f70-9419-4188-b7ae-d2a88c5de16a tempest-VolumesServicesTestJSON-872370903 None] Lock "cinder-quobyte-c89990f2-4358-4407-98ef-1a055f96eb67" acquired by "delete_volume" :: waited 0.032s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb80de5-0c25-405c-b536-a38d954fc58b]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6be03f70-9419-4188-b7ae-d2a88c5de16a tempest-VolumesServicesTestJSON-872370903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c89990f2-4358-4407-98ef-1a055f96eb67 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:47 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c89990f2-4358-4407-98ef-1a055f96eb67 Apr 27 10:13:47 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Flow 'volume_create_manager' (dee81ec3-a4ce-493a-8905-5497f7fe0e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73eb51b-3936-470d-9725-9ee94e9b5ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:47 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73eb51b-3936-470d-9725-9ee94e9b5ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:13:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1125512988',display_name='tempest-VolumesGetTest-Volume-510510929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f4f0eed-2f90-4099-ac6a-bae78cb65a56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4dee690a7fd41d3a3007b43cdb8d744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:47Z,use_quota=True,user_id='cfb2332f34f14f5187bd058c590656e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a1061c0-75cb-4be6-88d5-723f4e8698b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a1061c0-75cb-4be6-88d5-723f4e8698b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc9d66d-90a8-49a2-9ae7-4f7b54dbef24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc9d66d-90a8-49a2-9ae7-4f7b54dbef24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f4f0eed-2f90-4099-ac6a-bae78cb65a56', 'volume_name': 'volume-4f4f0eed-2f90-4099-ac6a-bae78cb65a56', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25463e3c-9171-48a6-beae-23f0e0aa9f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25463e3c-9171-48a6-beae-23f0e0aa9f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479faf9b-e48e-4044-9f3a-ab935f81d489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:47 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Volume 4f4f0eed-2f90-4099-ac6a-bae78cb65a56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f4f0eed-2f90-4099-ac6a-bae78cb65a56', 'volume_size': 1} Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:13:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1125512988',display_name='tempest-VolumesGetTest-Volume-510510929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f4f0eed-2f90-4099-ac6a-bae78cb65a56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4dee690a7fd41d3a3007b43cdb8d744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:47Z,use_quota=True,user_id='cfb2332f34f14f5187bd058c590656e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Creating volume 4f4f0eed-2f90-4099-ac6a-bae78cb65a56 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:13:47 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4f4f0eed-2f90-4099-ac6a-bae78cb65a56 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6be03f70-9419-4188-b7ae-d2a88c5de16a tempest-VolumesServicesTestJSON-872370903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c89990f2-4358-4407-98ef-1a055f96eb67" returned: 0 in 0.596s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6be03f70-9419-4188-b7ae-d2a88c5de16a tempest-VolumesServicesTestJSON-872370903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c89990f2-4358-4407-98ef-1a055f96eb67 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:47 devstack sudo[89064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4f4f0eed-2f90-4099-ac6a-bae78cb65a56 1073741824 Apr 27 10:13:47 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:47 devstack sudo[89065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c89990f2-4358-4407-98ef-1a055f96eb67 Apr 27 10:13:47 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:48 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6be03f70-9419-4188-b7ae-d2a88c5de16a tempest-VolumesServicesTestJSON-872370903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c89990f2-4358-4407-98ef-1a055f96eb67" returned: 0 in 0.464s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-6be03f70-9419-4188-b7ae-d2a88c5de16a tempest-VolumesServicesTestJSON-872370903 None] Lock "cinder-quobyte-c89990f2-4358-4407-98ef-1a055f96eb67" released by "delete_volume" :: held 1.101s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:48 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-6be03f70-9419-4188-b7ae-d2a88c5de16a tempest-VolumesServicesTestJSON-872370903 None] Created reservations ['0a17bfbb-e7cc-40d1-9984-fa6f2facb591', 'd154eec7-21f5-4341-a41d-9add9efda0ad', '2eabfa0c-6d30-47f0-b450-b86da0cd7e83', 'bb5cd283-f090-4cea-a4cd-cd89e205aa33'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:13:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-6be03f70-9419-4188-b7ae-d2a88c5de16a tempest-VolumesServicesTestJSON-872370903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-6be03f70-9419-4188-b7ae-d2a88c5de16a tempest-VolumesServicesTestJSON-872370903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-6be03f70-9419-4188-b7ae-d2a88c5de16a tempest-VolumesServicesTestJSON-872370903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:48 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-6be03f70-9419-4188-b7ae-d2a88c5de16a tempest-VolumesServicesTestJSON-872370903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-6be03f70-9419-4188-b7ae-d2a88c5de16a tempest-VolumesServicesTestJSON-872370903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6be03f70-9419-4188-b7ae-d2a88c5de16a tempest-VolumesServicesTestJSON-872370903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4f4f0eed-2f90-4099-ac6a-bae78cb65a56 1073741824" returned: 0 in 0.626s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:48 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:13:48 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4f4f0eed-2f90-4099-ac6a-bae78cb65a56 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:48 devstack sudo[89074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4f4f0eed-2f90-4099-ac6a-bae78cb65a56 Apr 27 10:13:48 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:48 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6be03f70-9419-4188-b7ae-d2a88c5de16a tempest-VolumesServicesTestJSON-872370903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.451s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:48 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-6be03f70-9419-4188-b7ae-d2a88c5de16a tempest-VolumesServicesTestJSON-872370903 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:13:48 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-6be03f70-9419-4188-b7ae-d2a88c5de16a tempest-VolumesServicesTestJSON-872370903 None] Deleted volume successfully. Apr 27 10:13:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-6be03f70-9419-4188-b7ae-d2a88c5de16a tempest-VolumesServicesTestJSON-872370903 None] Lock "cinder-c89990f2-4358-4407-98ef-1a055f96eb67-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:48 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4f4f0eed-2f90-4099-ac6a-bae78cb65a56" returned: 0 in 0.462s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:13:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479faf9b-e48e-4044-9f3a-ab935f81d489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f4f0eed-2f90-4099-ac6a-bae78cb65a56', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc57626-8525-43b0-9796-a0c8c395c408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:48 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Volume volume-4f4f0eed-2f90-4099-ac6a-bae78cb65a56 (4f4f0eed-2f90-4099-ac6a-bae78cb65a56): created successfully Apr 27 10:13:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc57626-8525-43b0-9796-a0c8c395c408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Flow 'volume_create_manager' (dee81ec3-a4ce-493a-8905-5497f7fe0e53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:48 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-39a8ec9f-3738-4988-a41f-b8f5adf05ebd tempest-VolumesGetTest-906688629 None] Created volume successfully. Apr 27 10:13:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-01be8c50-9875-4dca-a3f9-c0a847cb121e tempest-VolumesGetTest-906688629 None] Acquiring lock "cinder-4f4f0eed-2f90-4099-ac6a-bae78cb65a56-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-01be8c50-9875-4dca-a3f9-c0a847cb121e tempest-VolumesGetTest-906688629 None] Lock "cinder-4f4f0eed-2f90-4099-ac6a-bae78cb65a56-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-01be8c50-9875-4dca-a3f9-c0a847cb121e tempest-VolumesGetTest-906688629 None] Acquiring lock "cinder-quobyte-4f4f0eed-2f90-4099-ac6a-bae78cb65a56" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-01be8c50-9875-4dca-a3f9-c0a847cb121e tempest-VolumesGetTest-906688629 None] Lock "cinder-quobyte-4f4f0eed-2f90-4099-ac6a-bae78cb65a56" acquired by "delete_volume" :: waited 0.023s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:49 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[805a2ed0-2f09-481a-9a74-eb136eb728da]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-01be8c50-9875-4dca-a3f9-c0a847cb121e tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4f4f0eed-2f90-4099-ac6a-bae78cb65a56 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:49 devstack sudo[89078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4f4f0eed-2f90-4099-ac6a-bae78cb65a56 Apr 27 10:13:49 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:50 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-01be8c50-9875-4dca-a3f9-c0a847cb121e tempest-VolumesGetTest-906688629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4f4f0eed-2f90-4099-ac6a-bae78cb65a56" returned: 0 in 0.596s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-01be8c50-9875-4dca-a3f9-c0a847cb121e tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4f4f0eed-2f90-4099-ac6a-bae78cb65a56 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:50 devstack sudo[89083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4f4f0eed-2f90-4099-ac6a-bae78cb65a56 Apr 27 10:13:50 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:50 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-01be8c50-9875-4dca-a3f9-c0a847cb121e tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4f4f0eed-2f90-4099-ac6a-bae78cb65a56" returned: 0 in 0.500s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:50 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-01be8c50-9875-4dca-a3f9-c0a847cb121e tempest-VolumesGetTest-906688629 None] Lock "cinder-quobyte-4f4f0eed-2f90-4099-ac6a-bae78cb65a56" released by "delete_volume" :: held 1.139s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:51 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-01be8c50-9875-4dca-a3f9-c0a847cb121e tempest-VolumesGetTest-906688629 None] Created reservations ['e1d695f5-bb6f-4ea1-95cb-a6efb472d6e1', '203733cd-1d18-444d-bee2-40f972c23612', '6a4ec12a-3674-4685-abd4-6c892385d1ea', 'a5283cf7-0813-47f7-9891-5dad168043e4'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:13:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-01be8c50-9875-4dca-a3f9-c0a847cb121e tempest-VolumesGetTest-906688629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-01be8c50-9875-4dca-a3f9-c0a847cb121e tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:51 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-01be8c50-9875-4dca-a3f9-c0a847cb121e tempest-VolumesGetTest-906688629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:51 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-01be8c50-9875-4dca-a3f9-c0a847cb121e tempest-VolumesGetTest-906688629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-01be8c50-9875-4dca-a3f9-c0a847cb121e tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-01be8c50-9875-4dca-a3f9-c0a847cb121e tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:51 devstack sudo[89086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:13:51 devstack sudo[89086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:51 devstack sudo[89086]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-01be8c50-9875-4dca-a3f9-c0a847cb121e tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.502s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:51 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-01be8c50-9875-4dca-a3f9-c0a847cb121e tempest-VolumesGetTest-906688629 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:13:51 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-01be8c50-9875-4dca-a3f9-c0a847cb121e tempest-VolumesGetTest-906688629 None] Deleted volume successfully. Apr 27 10:13:51 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-01be8c50-9875-4dca-a3f9-c0a847cb121e tempest-VolumesGetTest-906688629 None] Lock "cinder-4f4f0eed-2f90-4099-ac6a-bae78cb65a56-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:52 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bc736ed1-53f3-44f9-9b9d-907634d0df38 tempest-VolumesGetTest-906688629 None] Acquiring lock "cinder-e26128d0-c870-4818-a809-627c73a76bc1-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:52 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bc736ed1-53f3-44f9-9b9d-907634d0df38 tempest-VolumesGetTest-906688629 None] Lock "cinder-e26128d0-c870-4818-a809-627c73a76bc1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:52 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bc736ed1-53f3-44f9-9b9d-907634d0df38 tempest-VolumesGetTest-906688629 None] Acquiring lock "cinder-quobyte-e26128d0-c870-4818-a809-627c73a76bc1" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:13:52 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bc736ed1-53f3-44f9-9b9d-907634d0df38 tempest-VolumesGetTest-906688629 None] Lock "cinder-quobyte-e26128d0-c870-4818-a809-627c73a76bc1" acquired by "delete_volume" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:13:52 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d944bb8a-1fc9-4a8e-93f3-2bb6bb9d85db]: (4, 'raw') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:13:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bc736ed1-53f3-44f9-9b9d-907634d0df38 tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:52 devstack sudo[89089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1 Apr 27 10:13:52 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:52 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bc736ed1-53f3-44f9-9b9d-907634d0df38 tempest-VolumesGetTest-906688629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1" returned: 0 in 0.600s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bc736ed1-53f3-44f9-9b9d-907634d0df38 tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:52 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1 Apr 27 10:13:52 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:53 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bc736ed1-53f3-44f9-9b9d-907634d0df38 tempest-VolumesGetTest-906688629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1" returned: 1 in 0.584s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bc736ed1-53f3-44f9-9b9d-907634d0df38 tempest-VolumesGetTest-906688629 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1' failed. Not Retrying. {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 10:13:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bc736ed1-53f3-44f9-9b9d-907634d0df38 tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:53 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1 Apr 27 10:13:53 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:53 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bc736ed1-53f3-44f9-9b9d-907634d0df38 tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-e26128d0-c870-4818-a809-627c73a76bc1" returned: 0 in 0.504s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:53 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bc736ed1-53f3-44f9-9b9d-907634d0df38 tempest-VolumesGetTest-906688629 None] Lock "cinder-quobyte-e26128d0-c870-4818-a809-627c73a76bc1" released by "delete_volume" :: held 1.748s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:53 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-bc736ed1-53f3-44f9-9b9d-907634d0df38 tempest-VolumesGetTest-906688629 None] Created reservations ['f3930b8d-ced6-49af-bd4a-c9ce766f5716', '044035fd-128a-455e-9138-fd49fadbadf9', '1fec6551-3bbd-4c20-a7ca-bf0bbdcf1e3d', '817a595c-87fb-4dd6-9e3e-e9029c7c34a7'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:13:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bc736ed1-53f3-44f9-9b9d-907634d0df38 tempest-VolumesGetTest-906688629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bc736ed1-53f3-44f9-9b9d-907634d0df38 tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-bc736ed1-53f3-44f9-9b9d-907634d0df38 tempest-VolumesGetTest-906688629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-bc736ed1-53f3-44f9-9b9d-907634d0df38 tempest-VolumesGetTest-906688629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bc736ed1-53f3-44f9-9b9d-907634d0df38 tempest-VolumesGetTest-906688629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bc736ed1-53f3-44f9-9b9d-907634d0df38 tempest-VolumesGetTest-906688629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:54 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:13:54 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:54 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bc736ed1-53f3-44f9-9b9d-907634d0df38 tempest-VolumesGetTest-906688629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.510s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:54 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-bc736ed1-53f3-44f9-9b9d-907634d0df38 tempest-VolumesGetTest-906688629 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:13:54 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-bc736ed1-53f3-44f9-9b9d-907634d0df38 tempest-VolumesGetTest-906688629 None] Deleted volume successfully. Apr 27 10:13:54 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bc736ed1-53f3-44f9-9b9d-907634d0df38 tempest-VolumesGetTest-906688629 None] Lock "cinder-e26128d0-c870-4818-a809-627c73a76bc1-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:13:57 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:13:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Flow 'volume_create_manager' (7315b76e-ac75-4a79-8381-d96223edc140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1189726f-3e7d-499c-9bc4-82a5241a2cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1189726f-3e7d-499c-9bc4-82a5241a2cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-88287590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3808ffcf-74e2-41be-a307-a5e48ceb510c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a07a7260bd32455dbfe1c472c1192b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:57Z,use_quota=True,user_id='0a23a9efc3b549d6ae7b5227c67ad433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61c364b2-ba05-4a4c-9f8f-7f9607ea75f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61c364b2-ba05-4a4c-9f8f-7f9607ea75f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8548f541-8e32-48d6-b0f9-386d05448289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8548f541-8e32-48d6-b0f9-386d05448289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3808ffcf-74e2-41be-a307-a5e48ceb510c', 'volume_name': 'volume-3808ffcf-74e2-41be-a307-a5e48ceb510c', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355eb3f6-1475-4de9-88a4-bcbfbf61c496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355eb3f6-1475-4de9-88a4-bcbfbf61c496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ddc5a2-e9aa-4c96-999c-fc653668d17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:57 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Volume 3808ffcf-74e2-41be-a307-a5e48ceb510c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3808ffcf-74e2-41be-a307-a5e48ceb510c', 'volume_size': 1} Apr 27 10:13:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-88287590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3808ffcf-74e2-41be-a307-a5e48ceb510c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a07a7260bd32455dbfe1c472c1192b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:13:57Z,use_quota=True,user_id='0a23a9efc3b549d6ae7b5227c67ad433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:13:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Creating volume 3808ffcf-74e2-41be-a307-a5e48ceb510c {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:13:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:13:57 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:13:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3808ffcf-74e2-41be-a307-a5e48ceb510c 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:57 devstack sudo[89139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3808ffcf-74e2-41be-a307-a5e48ceb510c 1073741824 Apr 27 10:13:57 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:58 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3808ffcf-74e2-41be-a307-a5e48ceb510c 1073741824" returned: 0 in 0.683s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3808ffcf-74e2-41be-a307-a5e48ceb510c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:58 devstack sudo[89144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3808ffcf-74e2-41be-a307-a5e48ceb510c Apr 27 10:13:58 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:13:58 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root Apr 27 10:13:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3808ffcf-74e2-41be-a307-a5e48ceb510c" returned: 0 in 0.494s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:13:58 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:13:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ddc5a2-e9aa-4c96-999c-fc653668d17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3808ffcf-74e2-41be-a307-a5e48ceb510c', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40496ff2-a206-4738-b0a0-00527d9e7472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:58 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Volume volume-3808ffcf-74e2-41be-a307-a5e48ceb510c (3808ffcf-74e2-41be-a307-a5e48ceb510c): created successfully Apr 27 10:13:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40496ff2-a206-4738-b0a0-00527d9e7472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Flow 'volume_create_manager' (7315b76e-ac75-4a79-8381-d96223edc140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:58 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-196c0044-9c75-40b0-bf11-ca16a1ccd19b tempest-VolumesListTestJSON-785191903 None] Created volume successfully. Apr 27 10:13:59 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:13:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Flow 'volume_create_manager' (5798488e-3e13-4fa7-a8b3-0c7d77a31f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:13:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1705649c-16a3-4a75-b6f0-7a97e792beda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1705649c-16a3-4a75-b6f0-7a97e792beda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-279079670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=029bda86-970b-4a84-85bb-ab818391e52d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a07a7260bd32455dbfe1c472c1192b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:14:00Z,use_quota=True,user_id='0a23a9efc3b549d6ae7b5227c67ad433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc90bc9-ac42-4866-b1af-915608892e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc90bc9-ac42-4866-b1af-915608892e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798759d5-b7da-40ce-87bc-b57b80b65f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798759d5-b7da-40ce-87bc-b57b80b65f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '029bda86-970b-4a84-85bb-ab818391e52d', 'volume_name': 'volume-029bda86-970b-4a84-85bb-ab818391e52d', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d73d42c6-dd27-4043-b328-5e9c79a90876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d73d42c6-dd27-4043-b328-5e9c79a90876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:13:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ff654e-0480-4a6b-8013-512de65e8ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:13:59 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Volume 029bda86-970b-4a84-85bb-ab818391e52d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-029bda86-970b-4a84-85bb-ab818391e52d', 'volume_size': 1} Apr 27 10:13:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-279079670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=029bda86-970b-4a84-85bb-ab818391e52d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a07a7260bd32455dbfe1c472c1192b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:14:00Z,use_quota=True,user_id='0a23a9efc3b549d6ae7b5227c67ad433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:13:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Creating volume 029bda86-970b-4a84-85bb-ab818391e52d {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:13:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:13:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:13:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:13:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:13:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:13:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:13:59 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:13:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-029bda86-970b-4a84-85bb-ab818391e52d 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:13:59 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-029bda86-970b-4a84-85bb-ab818391e52d 1073741824 Apr 27 10:13:59 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:00 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-029bda86-970b-4a84-85bb-ab818391e52d 1073741824" returned: 0 in 0.680s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-029bda86-970b-4a84-85bb-ab818391e52d {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:00 devstack sudo[89153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-029bda86-970b-4a84-85bb-ab818391e52d Apr 27 10:14:00 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:01 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-029bda86-970b-4a84-85bb-ab818391e52d" returned: 0 in 0.458s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:14:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:14:01 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ff654e-0480-4a6b-8013-512de65e8ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-029bda86-970b-4a84-85bb-ab818391e52d', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:01 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58bba8fb-56c2-41e7-b4a2-d845f3598de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:01 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Volume volume-029bda86-970b-4a84-85bb-ab818391e52d (029bda86-970b-4a84-85bb-ab818391e52d): created successfully Apr 27 10:14:01 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58bba8fb-56c2-41e7-b4a2-d845f3598de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:01 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Flow 'volume_create_manager' (5798488e-3e13-4fa7-a8b3-0c7d77a31f74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:14:01 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-0a137a79-7e9e-4428-b020-97a96a342657 tempest-VolumesListTestJSON-785191903 None] Created volume successfully. Apr 27 10:14:02 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:14:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Flow 'volume_create_manager' (a3d291ba-c622-48ea-a9f0-aa77c28f9082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:14:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf6fc638-cdc6-4a51-97c4-cc106b23b6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf6fc638-cdc6-4a51-97c4-cc106b23b6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-921339656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43a5030d-0497-400e-9257-6267ee3df987,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a07a7260bd32455dbfe1c472c1192b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:14:02Z,use_quota=True,user_id='0a23a9efc3b549d6ae7b5227c67ad433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2586b5-4ef3-4888-8db4-6d248abaf12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2586b5-4ef3-4888-8db4-6d248abaf12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7be8196-176b-441c-bd45-63ddb479ca79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7be8196-176b-441c-bd45-63ddb479ca79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43a5030d-0497-400e-9257-6267ee3df987', 'volume_name': 'volume-43a5030d-0497-400e-9257-6267ee3df987', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38df8856-a990-49e5-8141-82205f2e5585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38df8856-a990-49e5-8141-82205f2e5585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:02 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b3f4ef-cb1f-4f50-8996-65f13295ad48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:02 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Volume 43a5030d-0497-400e-9257-6267ee3df987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43a5030d-0497-400e-9257-6267ee3df987', 'volume_size': 1} Apr 27 10:14:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:14:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:14:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-921339656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43a5030d-0497-400e-9257-6267ee3df987,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a07a7260bd32455dbfe1c472c1192b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:14:02Z,use_quota=True,user_id='0a23a9efc3b549d6ae7b5227c67ad433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:14:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Creating volume 43a5030d-0497-400e-9257-6267ee3df987 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:14:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:14:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:14:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:14:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:14:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:14:02 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:14:02 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:14:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-43a5030d-0497-400e-9257-6267ee3df987 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:02 devstack sudo[89156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-43a5030d-0497-400e-9257-6267ee3df987 1073741824 Apr 27 10:14:02 devstack sudo[89156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:03 devstack sudo[89156]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-43a5030d-0497-400e-9257-6267ee3df987 1073741824" returned: 0 in 0.639s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-43a5030d-0497-400e-9257-6267ee3df987 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:03 devstack sudo[89161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-43a5030d-0497-400e-9257-6267ee3df987 Apr 27 10:14:03 devstack sudo[89161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:03 devstack sudo[89161]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-43a5030d-0497-400e-9257-6267ee3df987" returned: 0 in 0.513s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:14:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:14:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b3f4ef-cb1f-4f50-8996-65f13295ad48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43a5030d-0497-400e-9257-6267ee3df987', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea77495d-033e-471a-bb28-b8782ad5a31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:03 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Volume volume-43a5030d-0497-400e-9257-6267ee3df987 (43a5030d-0497-400e-9257-6267ee3df987): created successfully Apr 27 10:14:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea77495d-033e-471a-bb28-b8782ad5a31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Flow 'volume_create_manager' (a3d291ba-c622-48ea-a9f0-aa77c28f9082) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:14:03 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-d9b1d500-5b06-4c1c-b9b0-81df8e70cba3 tempest-VolumesListTestJSON-785191903 None] Created volume successfully. Apr 27 10:14:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8c040bf9-4a72-4a2f-8e5a-1e120dc0f5b2 tempest-VolumesListTestJSON-785191903 None] Acquiring lock "cinder-43a5030d-0497-400e-9257-6267ee3df987-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:14:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8c040bf9-4a72-4a2f-8e5a-1e120dc0f5b2 tempest-VolumesListTestJSON-785191903 None] Lock "cinder-43a5030d-0497-400e-9257-6267ee3df987-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:14:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8c040bf9-4a72-4a2f-8e5a-1e120dc0f5b2 tempest-VolumesListTestJSON-785191903 None] Acquiring lock "cinder-quobyte-43a5030d-0497-400e-9257-6267ee3df987" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:14:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8c040bf9-4a72-4a2f-8e5a-1e120dc0f5b2 tempest-VolumesListTestJSON-785191903 None] Lock "cinder-quobyte-43a5030d-0497-400e-9257-6267ee3df987" acquired by "delete_volume" :: waited 0.023s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:14:06 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb56eb2c-d4db-43b0-bbb8-3ad16969a804]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:14:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c040bf9-4a72-4a2f-8e5a-1e120dc0f5b2 tempest-VolumesListTestJSON-785191903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-43a5030d-0497-400e-9257-6267ee3df987 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:07 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-43a5030d-0497-400e-9257-6267ee3df987 Apr 27 10:14:07 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:07 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c040bf9-4a72-4a2f-8e5a-1e120dc0f5b2 tempest-VolumesListTestJSON-785191903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-43a5030d-0497-400e-9257-6267ee3df987" returned: 0 in 0.630s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c040bf9-4a72-4a2f-8e5a-1e120dc0f5b2 tempest-VolumesListTestJSON-785191903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-43a5030d-0497-400e-9257-6267ee3df987 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:07 devstack sudo[89170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-43a5030d-0497-400e-9257-6267ee3df987 Apr 27 10:14:07 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:08 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c040bf9-4a72-4a2f-8e5a-1e120dc0f5b2 tempest-VolumesListTestJSON-785191903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-43a5030d-0497-400e-9257-6267ee3df987" returned: 0 in 0.526s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8c040bf9-4a72-4a2f-8e5a-1e120dc0f5b2 tempest-VolumesListTestJSON-785191903 None] Lock "cinder-quobyte-43a5030d-0497-400e-9257-6267ee3df987" released by "delete_volume" :: held 1.201s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:14:08 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-8c040bf9-4a72-4a2f-8e5a-1e120dc0f5b2 tempest-VolumesListTestJSON-785191903 None] Created reservations ['28a0b7e4-e5ea-4e6f-8f17-022f9ffe45e8', '40f89699-8020-4ab2-a693-58a0ee294b93', 'cc3d8451-edb8-468d-a855-3bbe779ed274', '85f0f980-2a49-4fdf-bdcb-0f529f1ebbc1'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:14:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8c040bf9-4a72-4a2f-8e5a-1e120dc0f5b2 tempest-VolumesListTestJSON-785191903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:14:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8c040bf9-4a72-4a2f-8e5a-1e120dc0f5b2 tempest-VolumesListTestJSON-785191903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:14:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8c040bf9-4a72-4a2f-8e5a-1e120dc0f5b2 tempest-VolumesListTestJSON-785191903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:14:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8c040bf9-4a72-4a2f-8e5a-1e120dc0f5b2 tempest-VolumesListTestJSON-785191903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:14:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8c040bf9-4a72-4a2f-8e5a-1e120dc0f5b2 tempest-VolumesListTestJSON-785191903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:14:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c040bf9-4a72-4a2f-8e5a-1e120dc0f5b2 tempest-VolumesListTestJSON-785191903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:08 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:14:08 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:08 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c040bf9-4a72-4a2f-8e5a-1e120dc0f5b2 tempest-VolumesListTestJSON-785191903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.494s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:08 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-8c040bf9-4a72-4a2f-8e5a-1e120dc0f5b2 tempest-VolumesListTestJSON-785191903 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:14:08 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-8c040bf9-4a72-4a2f-8e5a-1e120dc0f5b2 tempest-VolumesListTestJSON-785191903 None] Deleted volume successfully. Apr 27 10:14:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8c040bf9-4a72-4a2f-8e5a-1e120dc0f5b2 tempest-VolumesListTestJSON-785191903 None] Lock "cinder-43a5030d-0497-400e-9257-6267ee3df987-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:14:09 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-4ddf3302-1582-40d8-9e57-cd28f66975d3 tempest-VolumesListTestJSON-785191903 None] Acquiring lock "cinder-029bda86-970b-4a84-85bb-ab818391e52d-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:14:09 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-4ddf3302-1582-40d8-9e57-cd28f66975d3 tempest-VolumesListTestJSON-785191903 None] Lock "cinder-029bda86-970b-4a84-85bb-ab818391e52d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:14:09 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-4ddf3302-1582-40d8-9e57-cd28f66975d3 tempest-VolumesListTestJSON-785191903 None] Acquiring lock "cinder-quobyte-029bda86-970b-4a84-85bb-ab818391e52d" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:14:09 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-4ddf3302-1582-40d8-9e57-cd28f66975d3 tempest-VolumesListTestJSON-785191903 None] Lock "cinder-quobyte-029bda86-970b-4a84-85bb-ab818391e52d" acquired by "delete_volume" :: waited 0.020s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:14:09 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6c07ce-78ee-439c-8428-46185161a0cd]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:14:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-4ddf3302-1582-40d8-9e57-cd28f66975d3 tempest-VolumesListTestJSON-785191903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-029bda86-970b-4a84-85bb-ab818391e52d {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:09 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-029bda86-970b-4a84-85bb-ab818391e52d Apr 27 10:14:09 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:09 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-4ddf3302-1582-40d8-9e57-cd28f66975d3 tempest-VolumesListTestJSON-785191903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-029bda86-970b-4a84-85bb-ab818391e52d" returned: 0 in 0.621s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-4ddf3302-1582-40d8-9e57-cd28f66975d3 tempest-VolumesListTestJSON-785191903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-029bda86-970b-4a84-85bb-ab818391e52d {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:09 devstack sudo[89182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-029bda86-970b-4a84-85bb-ab818391e52d Apr 27 10:14:09 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:10 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-4ddf3302-1582-40d8-9e57-cd28f66975d3 tempest-VolumesListTestJSON-785191903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-029bda86-970b-4a84-85bb-ab818391e52d" returned: 0 in 0.492s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-4ddf3302-1582-40d8-9e57-cd28f66975d3 tempest-VolumesListTestJSON-785191903 None] Lock "cinder-quobyte-029bda86-970b-4a84-85bb-ab818391e52d" released by "delete_volume" :: held 1.155s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:14:10 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-4ddf3302-1582-40d8-9e57-cd28f66975d3 tempest-VolumesListTestJSON-785191903 None] Created reservations ['3bb67e2f-8567-426b-8333-3a75ef43afdc', '32ff6665-420c-4b7e-b4c4-fec6ca51cc5e', '52d7b2b3-6858-4eb7-897d-3af9fa83e87b', '82199b8b-ab28-451a-b577-f6567cf3cd8a'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:14:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-4ddf3302-1582-40d8-9e57-cd28f66975d3 tempest-VolumesListTestJSON-785191903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:14:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-4ddf3302-1582-40d8-9e57-cd28f66975d3 tempest-VolumesListTestJSON-785191903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:14:10 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf3302-1582-40d8-9e57-cd28f66975d3 tempest-VolumesListTestJSON-785191903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:14:10 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf3302-1582-40d8-9e57-cd28f66975d3 tempest-VolumesListTestJSON-785191903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:14:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-4ddf3302-1582-40d8-9e57-cd28f66975d3 tempest-VolumesListTestJSON-785191903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:14:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-4ddf3302-1582-40d8-9e57-cd28f66975d3 tempest-VolumesListTestJSON-785191903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:10 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:14:10 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:11 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-4ddf3302-1582-40d8-9e57-cd28f66975d3 tempest-VolumesListTestJSON-785191903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.510s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:11 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-4ddf3302-1582-40d8-9e57-cd28f66975d3 tempest-VolumesListTestJSON-785191903 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:14:11 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-4ddf3302-1582-40d8-9e57-cd28f66975d3 tempest-VolumesListTestJSON-785191903 None] Deleted volume successfully. Apr 27 10:14:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-4ddf3302-1582-40d8-9e57-cd28f66975d3 tempest-VolumesListTestJSON-785191903 None] Lock "cinder-029bda86-970b-4a84-85bb-ab818391e52d-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:14:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-910345b8-2e18-46b3-8428-3e688cd92181 tempest-VolumesListTestJSON-785191903 None] Acquiring lock "cinder-3808ffcf-74e2-41be-a307-a5e48ceb510c-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:14:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-910345b8-2e18-46b3-8428-3e688cd92181 tempest-VolumesListTestJSON-785191903 None] Lock "cinder-3808ffcf-74e2-41be-a307-a5e48ceb510c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:14:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-910345b8-2e18-46b3-8428-3e688cd92181 tempest-VolumesListTestJSON-785191903 None] Acquiring lock "cinder-quobyte-3808ffcf-74e2-41be-a307-a5e48ceb510c" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:14:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-910345b8-2e18-46b3-8428-3e688cd92181 tempest-VolumesListTestJSON-785191903 None] Lock "cinder-quobyte-3808ffcf-74e2-41be-a307-a5e48ceb510c" acquired by "delete_volume" :: waited 0.014s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:14:11 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ad6197-8217-492c-b875-891f445c426e]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:14:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-910345b8-2e18-46b3-8428-3e688cd92181 tempest-VolumesListTestJSON-785191903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3808ffcf-74e2-41be-a307-a5e48ceb510c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:11 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3808ffcf-74e2-41be-a307-a5e48ceb510c Apr 27 10:14:11 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:12 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-910345b8-2e18-46b3-8428-3e688cd92181 tempest-VolumesListTestJSON-785191903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3808ffcf-74e2-41be-a307-a5e48ceb510c" returned: 0 in 0.601s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-910345b8-2e18-46b3-8428-3e688cd92181 tempest-VolumesListTestJSON-785191903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3808ffcf-74e2-41be-a307-a5e48ceb510c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:12 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3808ffcf-74e2-41be-a307-a5e48ceb510c Apr 27 10:14:12 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:12 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-910345b8-2e18-46b3-8428-3e688cd92181 tempest-VolumesListTestJSON-785191903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3808ffcf-74e2-41be-a307-a5e48ceb510c" returned: 0 in 0.534s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:12 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-910345b8-2e18-46b3-8428-3e688cd92181 tempest-VolumesListTestJSON-785191903 None] Lock "cinder-quobyte-3808ffcf-74e2-41be-a307-a5e48ceb510c" released by "delete_volume" :: held 1.181s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:14:12 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-910345b8-2e18-46b3-8428-3e688cd92181 tempest-VolumesListTestJSON-785191903 None] Created reservations ['ade9cb64-2a0b-4faa-b2fb-d3db6098fead', '87fa3344-bd18-4d87-bf52-42f7f72b7030', 'ae383843-9efd-40aa-acce-e6971ccc9853', '9218e240-1002-4359-9135-01a0cb707480'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:14:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-910345b8-2e18-46b3-8428-3e688cd92181 tempest-VolumesListTestJSON-785191903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:14:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-910345b8-2e18-46b3-8428-3e688cd92181 tempest-VolumesListTestJSON-785191903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:14:12 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-910345b8-2e18-46b3-8428-3e688cd92181 tempest-VolumesListTestJSON-785191903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:14:12 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-910345b8-2e18-46b3-8428-3e688cd92181 tempest-VolumesListTestJSON-785191903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:14:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-910345b8-2e18-46b3-8428-3e688cd92181 tempest-VolumesListTestJSON-785191903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:14:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-910345b8-2e18-46b3-8428-3e688cd92181 tempest-VolumesListTestJSON-785191903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:12 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:14:12 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:13 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-910345b8-2e18-46b3-8428-3e688cd92181 tempest-VolumesListTestJSON-785191903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.489s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:13 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-910345b8-2e18-46b3-8428-3e688cd92181 tempest-VolumesListTestJSON-785191903 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:14:13 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-910345b8-2e18-46b3-8428-3e688cd92181 tempest-VolumesListTestJSON-785191903 None] Deleted volume successfully. Apr 27 10:14:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-910345b8-2e18-46b3-8428-3e688cd92181 tempest-VolumesListTestJSON-785191903 None] Lock "cinder-3808ffcf-74e2-41be-a307-a5e48ceb510c-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG oslo_service.periodic_task [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81350) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:16 devstack sudo[89208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:14:16 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Flow 'volume_create_manager' (9545fc0c-224c-416d-8b47-17c26d39cd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c731d4-22ce-4498-b0e6-3a38c430793d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c731d4-22ce-4498-b0e6-3a38c430793d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1529702458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151b7bec-6b29-4f0b-8ad9-22f7752885cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2273a20ab5994c47bddfff10338edb1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:14:17Z,use_quota=True,user_id='5942eee61ce643a9a161bf2800667a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0768024-4a08-42c2-b970-0cb02d938ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0768024-4a08-42c2-b970-0cb02d938ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84bc6805-2c13-4e20-b178-8e6b98a77549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84bc6805-2c13-4e20-b178-8e6b98a77549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '151b7bec-6b29-4f0b-8ad9-22f7752885cb', 'volume_name': 'volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57974e4e-4421-429d-a417-751941a51495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57974e4e-4421-429d-a417-751941a51495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74dfde80-29b4-4219-9145-ab75fde63dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:16 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Volume 151b7bec-6b29-4f0b-8ad9-22f7752885cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb', 'volume_size': 1} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1529702458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151b7bec-6b29-4f0b-8ad9-22f7752885cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2273a20ab5994c47bddfff10338edb1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:14:17Z,use_quota=True,user_id='5942eee61ce643a9a161bf2800667a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Creating volume 151b7bec-6b29-4f0b-8ad9-22f7752885cb {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:14:16 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:14:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:16 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb 1073741824 Apr 27 10:14:16 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:17 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.466s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:17 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:14:17 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb 1073741824" returned: 0 in 0.706s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:17 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb Apr 27 10:14:17 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:17 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb" returned: 0 in 0.469s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:17 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:14:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:14:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74dfde80-29b4-4219-9145-ab75fde63dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f36ffb-4601-4cca-851e-7f6a49f5b14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:18 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Volume volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb (151b7bec-6b29-4f0b-8ad9-22f7752885cb): created successfully Apr 27 10:14:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f36ffb-4601-4cca-851e-7f6a49f5b14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Flow 'volume_create_manager' (9545fc0c-224c-416d-8b47-17c26d39cd65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:14:18 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-e0a0215f-90c7-4ab4-9bbf-a5a6d01aaae2 tempest-VolumesSnapshotListTestJSON-1113673011 None] Created volume successfully. Apr 27 10:14:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-37e8315e-ec4d-411f-adea-e266da4adb65 tempest-VolumesSnapshotListTestJSON-1113673011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:14:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-37e8315e-ec4d-411f-adea-e266da4adb65 tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:14:19 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-37e8315e-ec4d-411f-adea-e266da4adb65 tempest-VolumesSnapshotListTestJSON-1113673011 None] Creating offline snapshot faa97e1f-75fb-4257-954f-d96fc58c38b1 of volume 151b7bec-6b29-4f0b-8ad9-22f7752885cb {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:14:19 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4413121a-4032-4885-a8ee-015713c1c618]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:14:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-37e8315e-ec4d-411f-adea-e266da4adb65 tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:19 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb Apr 27 10:14:19 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:19 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-37e8315e-ec4d-411f-adea-e266da4adb65 tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb" returned: 0 in 0.577s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-37e8315e-ec4d-411f-adea-e266da4adb65 tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:19 devstack sudo[89224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1 1G Apr 27 10:14:19 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:20 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-37e8315e-ec4d-411f-adea-e266da4adb65 tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1 1G" returned: 0 in 0.691s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-37e8315e-ec4d-411f-adea-e266da4adb65 tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:20 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1 Apr 27 10:14:20 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:20 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-37e8315e-ec4d-411f-adea-e266da4adb65 tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1" returned: 0 in 0.596s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:20 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-37e8315e-ec4d-411f-adea-e266da4adb65 tempest-VolumesSnapshotListTestJSON-1113673011 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1 is being set with open permissions: ugo+rw Apr 27 10:14:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-37e8315e-ec4d-411f-adea-e266da4adb65 tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:20 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1 Apr 27 10:14:20 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:21 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-37e8315e-ec4d-411f-adea-e266da4adb65 tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1" returned: 0 in 0.514s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-37e8315e-ec4d-411f-adea-e266da4adb65 tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:21 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.info Apr 27 10:14:21 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:21 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-37e8315e-ec4d-411f-adea-e266da4adb65 tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.info" returned: 0 in 0.498s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:21 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-37e8315e-ec4d-411f-adea-e266da4adb65 tempest-VolumesSnapshotListTestJSON-1113673011 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.info is being set with open permissions: ugo+rw Apr 27 10:14:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-37e8315e-ec4d-411f-adea-e266da4adb65 tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:21 devstack sudo[89240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.info Apr 27 10:14:21 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:22 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-37e8315e-ec4d-411f-adea-e266da4adb65 tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.info" returned: 0 in 0.458s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-37e8315e-ec4d-411f-adea-e266da4adb65 tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.425s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:14:22 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-37e8315e-ec4d-411f-adea-e266da4adb65 tempest-VolumesSnapshotListTestJSON-1113673011 None] Create snapshot completed successfully Apr 27 10:14:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b563507a-dacf-461d-a935-17d0f9423030 tempest-VolumesSnapshotListTestJSON-1113673011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:14:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b563507a-dacf-461d-a935-17d0f9423030 tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:14:23 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-b563507a-dacf-461d-a935-17d0f9423030 tempest-VolumesSnapshotListTestJSON-1113673011 None] Creating offline snapshot 640f1a71-da7b-4461-8540-0692a8e63be9 of volume 151b7bec-6b29-4f0b-8ad9-22f7752885cb {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:14:23 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bab2244-d9ef-49d9-a84a-8818ba6d3cb7]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:14:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b563507a-dacf-461d-a935-17d0f9423030 tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:23 devstack sudo[89247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1 Apr 27 10:14:23 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:23 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b563507a-dacf-461d-a935-17d0f9423030 tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1" returned: 0 in 0.529s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:23 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-b563507a-dacf-461d-a935-17d0f9423030 tempest-VolumesSnapshotListTestJSON-1113673011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:14:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b563507a-dacf-461d-a935-17d0f9423030 tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:23 devstack sudo[89252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9 1G Apr 27 10:14:23 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:24 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b563507a-dacf-461d-a935-17d0f9423030 tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9 1G" returned: 0 in 0.629s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b563507a-dacf-461d-a935-17d0f9423030 tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:24 devstack sudo[89257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9 Apr 27 10:14:24 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:25 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b563507a-dacf-461d-a935-17d0f9423030 tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9" returned: 0 in 0.496s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:25 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-b563507a-dacf-461d-a935-17d0f9423030 tempest-VolumesSnapshotListTestJSON-1113673011 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9 is being set with open permissions: ugo+rw Apr 27 10:14:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b563507a-dacf-461d-a935-17d0f9423030 tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:25 devstack sudo[89263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9 Apr 27 10:14:25 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:25 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b563507a-dacf-461d-a935-17d0f9423030 tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9" returned: 0 in 0.452s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b563507a-dacf-461d-a935-17d0f9423030 tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.200s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:14:25 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-b563507a-dacf-461d-a935-17d0f9423030 tempest-VolumesSnapshotListTestJSON-1113673011 None] Create snapshot completed successfully Apr 27 10:14:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f39fc122-225f-41ac-9dc8-8f1d6266b55b tempest-VolumesSnapshotListTestJSON-1113673011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:14:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f39fc122-225f-41ac-9dc8-8f1d6266b55b tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:14:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-f39fc122-225f-41ac-9dc8-8f1d6266b55b tempest-VolumesSnapshotListTestJSON-1113673011 None] Creating offline snapshot dab3005e-0820-4ec8-9c87-dbd2e46893a8 of volume 151b7bec-6b29-4f0b-8ad9-22f7752885cb {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:14:26 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7344fd-6641-4ea2-8902-9cc5b6184b39]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:14:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f39fc122-225f-41ac-9dc8-8f1d6266b55b tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:26 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9 Apr 27 10:14:26 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:27 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f39fc122-225f-41ac-9dc8-8f1d6266b55b tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9" returned: 0 in 0.583s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:27 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-f39fc122-225f-41ac-9dc8-8f1d6266b55b tempest-VolumesSnapshotListTestJSON-1113673011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:14:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f39fc122-225f-41ac-9dc8-8f1d6266b55b tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.dab3005e-0820-4ec8-9c87-dbd2e46893a8 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:27 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.dab3005e-0820-4ec8-9c87-dbd2e46893a8 1G Apr 27 10:14:27 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:28 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f39fc122-225f-41ac-9dc8-8f1d6266b55b tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.dab3005e-0820-4ec8-9c87-dbd2e46893a8 1G" returned: 0 in 0.879s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f39fc122-225f-41ac-9dc8-8f1d6266b55b tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.dab3005e-0820-4ec8-9c87-dbd2e46893a8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:28 devstack sudo[89276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.dab3005e-0820-4ec8-9c87-dbd2e46893a8 Apr 27 10:14:28 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:28 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f39fc122-225f-41ac-9dc8-8f1d6266b55b tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.dab3005e-0820-4ec8-9c87-dbd2e46893a8" returned: 0 in 0.568s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:28 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-f39fc122-225f-41ac-9dc8-8f1d6266b55b tempest-VolumesSnapshotListTestJSON-1113673011 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.dab3005e-0820-4ec8-9c87-dbd2e46893a8 is being set with open permissions: ugo+rw Apr 27 10:14:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f39fc122-225f-41ac-9dc8-8f1d6266b55b tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.dab3005e-0820-4ec8-9c87-dbd2e46893a8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:28 devstack sudo[89281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.dab3005e-0820-4ec8-9c87-dbd2e46893a8 Apr 27 10:14:28 devstack sudo[89281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:29 devstack sudo[89281]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f39fc122-225f-41ac-9dc8-8f1d6266b55b tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.dab3005e-0820-4ec8-9c87-dbd2e46893a8" returned: 0 in 0.468s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f39fc122-225f-41ac-9dc8-8f1d6266b55b tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.590s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:14:29 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:UPDATE=118,cinder:SELECT=94,cinder:DELETE=10,cinder:INSERT=32 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:14:29 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-f39fc122-225f-41ac-9dc8-8f1d6266b55b tempest-VolumesSnapshotListTestJSON-1113673011 None] Create snapshot completed successfully Apr 27 10:14:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e3e940fb-9683-4068-aa32-41bbbb1866c3 tempest-VolumesSnapshotListTestJSON-1113673011 None] Acquiring lock "cinder-dab3005e-0820-4ec8-9c87-dbd2e46893a8-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:14:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e3e940fb-9683-4068-aa32-41bbbb1866c3 tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "cinder-dab3005e-0820-4ec8-9c87-dbd2e46893a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:14:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e3e940fb-9683-4068-aa32-41bbbb1866c3 tempest-VolumesSnapshotListTestJSON-1113673011 None] Acquiring lock "cinder-quobyte-151b7bec-6b29-4f0b-8ad9-22f7752885cb" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:14:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e3e940fb-9683-4068-aa32-41bbbb1866c3 tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "cinder-quobyte-151b7bec-6b29-4f0b-8ad9-22f7752885cb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:14:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e3e940fb-9683-4068-aa32-41bbbb1866c3 tempest-VolumesSnapshotListTestJSON-1113673011 None] Acquiring lock "cinder-quobyte-dab3005e-0820-4ec8-9c87-dbd2e46893a8" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:14:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e3e940fb-9683-4068-aa32-41bbbb1866c3 tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "cinder-quobyte-dab3005e-0820-4ec8-9c87-dbd2e46893a8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:14:30 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-e3e940fb-9683-4068-aa32-41bbbb1866c3 tempest-VolumesSnapshotListTestJSON-1113673011 None] Deleting offline snapshot dab3005e-0820-4ec8-9c87-dbd2e46893a8 of volume 151b7bec-6b29-4f0b-8ad9-22f7752885cb {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:14:30 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-e3e940fb-9683-4068-aa32-41bbbb1866c3 tempest-VolumesSnapshotListTestJSON-1113673011 None] snapshot_file for this snap is: volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.dab3005e-0820-4ec8-9c87-dbd2e46893a8 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:14:30 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f9bd6e-7531-4858-8803-e9d3015567c5]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:14:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e3e940fb-9683-4068-aa32-41bbbb1866c3 tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.dab3005e-0820-4ec8-9c87-dbd2e46893a8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:30 devstack sudo[89300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.dab3005e-0820-4ec8-9c87-dbd2e46893a8 Apr 27 10:14:30 devstack sudo[89300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:31 devstack sudo[89300]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e3e940fb-9683-4068-aa32-41bbbb1866c3 tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.dab3005e-0820-4ec8-9c87-dbd2e46893a8" returned: 0 in 0.577s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:31 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-e3e940fb-9683-4068-aa32-41bbbb1866c3 tempest-VolumesSnapshotListTestJSON-1113673011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:14:31 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da5fe81-cf5f-4e0f-b7ee-d1dcce75f36d]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:14:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e3e940fb-9683-4068-aa32-41bbbb1866c3 tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:31 devstack sudo[89307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9 Apr 27 10:14:31 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:31 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e3e940fb-9683-4068-aa32-41bbbb1866c3 tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9" returned: 0 in 0.528s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:31 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-e3e940fb-9683-4068-aa32-41bbbb1866c3 tempest-VolumesSnapshotListTestJSON-1113673011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:14:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e3e940fb-9683-4068-aa32-41bbbb1866c3 tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.dab3005e-0820-4ec8-9c87-dbd2e46893a8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:31 devstack sudo[89312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.dab3005e-0820-4ec8-9c87-dbd2e46893a8 Apr 27 10:14:31 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:32 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e3e940fb-9683-4068-aa32-41bbbb1866c3 tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.dab3005e-0820-4ec8-9c87-dbd2e46893a8" returned: 0 in 0.667s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e3e940fb-9683-4068-aa32-41bbbb1866c3 tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.dab3005e-0820-4ec8-9c87-dbd2e46893a8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:32 devstack sudo[89320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.dab3005e-0820-4ec8-9c87-dbd2e46893a8 Apr 27 10:14:32 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:32 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e3e940fb-9683-4068-aa32-41bbbb1866c3 tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.dab3005e-0820-4ec8-9c87-dbd2e46893a8" returned: 0 in 0.454s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e3e940fb-9683-4068-aa32-41bbbb1866c3 tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "cinder-quobyte-dab3005e-0820-4ec8-9c87-dbd2e46893a8" released by "_delete_snapshot" :: held 2.333s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:14:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e3e940fb-9683-4068-aa32-41bbbb1866c3 tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "cinder-quobyte-151b7bec-6b29-4f0b-8ad9-22f7752885cb" released by "delete_snapshot" :: held 2.363s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:14:32 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-e3e940fb-9683-4068-aa32-41bbbb1866c3 tempest-VolumesSnapshotListTestJSON-1113673011 None] Created reservations ['0a5fc869-19b4-4279-85e0-c6fd7741c818', 'dbb98390-0243-494c-87a8-2b55aaf4b10d', '83a5fed2-2e27-4cd1-b6a6-00273f203d4c', '48e9836c-ca87-469a-9c89-a2b8850ca034'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:14:33 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-e3e940fb-9683-4068-aa32-41bbbb1866c3 tempest-VolumesSnapshotListTestJSON-1113673011 None] Delete snapshot completed successfully. Apr 27 10:14:33 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e3e940fb-9683-4068-aa32-41bbbb1866c3 tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "cinder-dab3005e-0820-4ec8-9c87-dbd2e46893a8-delete_snapshot" released by "delete_snapshot" :: held 2.497s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:14:33 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1d37e14e-27fb-4db5-9355-84175ecea1ac tempest-VolumesSnapshotListTestJSON-1113673011 None] Acquiring lock "cinder-640f1a71-da7b-4461-8540-0692a8e63be9-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:14:33 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1d37e14e-27fb-4db5-9355-84175ecea1ac tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "cinder-640f1a71-da7b-4461-8540-0692a8e63be9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:14:33 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1d37e14e-27fb-4db5-9355-84175ecea1ac tempest-VolumesSnapshotListTestJSON-1113673011 None] Acquiring lock "cinder-quobyte-151b7bec-6b29-4f0b-8ad9-22f7752885cb" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:14:33 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1d37e14e-27fb-4db5-9355-84175ecea1ac tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "cinder-quobyte-151b7bec-6b29-4f0b-8ad9-22f7752885cb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:14:33 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1d37e14e-27fb-4db5-9355-84175ecea1ac tempest-VolumesSnapshotListTestJSON-1113673011 None] Acquiring lock "cinder-quobyte-640f1a71-da7b-4461-8540-0692a8e63be9" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:14:34 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1d37e14e-27fb-4db5-9355-84175ecea1ac tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "cinder-quobyte-640f1a71-da7b-4461-8540-0692a8e63be9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:14:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-1d37e14e-27fb-4db5-9355-84175ecea1ac tempest-VolumesSnapshotListTestJSON-1113673011 None] Deleting offline snapshot 640f1a71-da7b-4461-8540-0692a8e63be9 of volume 151b7bec-6b29-4f0b-8ad9-22f7752885cb {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:14:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-1d37e14e-27fb-4db5-9355-84175ecea1ac tempest-VolumesSnapshotListTestJSON-1113673011 None] snapshot_file for this snap is: volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:14:34 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[507fd6d7-9158-406c-ad7d-6cfd098ddc41]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:14:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1d37e14e-27fb-4db5-9355-84175ecea1ac tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:34 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9 Apr 27 10:14:34 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:34 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1d37e14e-27fb-4db5-9355-84175ecea1ac tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9" returned: 0 in 0.581s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-1d37e14e-27fb-4db5-9355-84175ecea1ac tempest-VolumesSnapshotListTestJSON-1113673011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:14:34 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc5aa6b-6433-47ba-a259-048cd57e5818]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:14:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1d37e14e-27fb-4db5-9355-84175ecea1ac tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:34 devstack sudo[89343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1 Apr 27 10:14:34 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:35 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1d37e14e-27fb-4db5-9355-84175ecea1ac tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1" returned: 0 in 0.638s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-1d37e14e-27fb-4db5-9355-84175ecea1ac tempest-VolumesSnapshotListTestJSON-1113673011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:14:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1d37e14e-27fb-4db5-9355-84175ecea1ac tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:35 devstack sudo[89366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9 Apr 27 10:14:35 devstack sudo[89366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:36 devstack sudo[89366]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1d37e14e-27fb-4db5-9355-84175ecea1ac tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9" returned: 0 in 0.803s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1d37e14e-27fb-4db5-9355-84175ecea1ac tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:36 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9 Apr 27 10:14:36 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:36 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1d37e14e-27fb-4db5-9355-84175ecea1ac tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.640f1a71-da7b-4461-8540-0692a8e63be9" returned: 0 in 0.482s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1d37e14e-27fb-4db5-9355-84175ecea1ac tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "cinder-quobyte-640f1a71-da7b-4461-8540-0692a8e63be9" released by "_delete_snapshot" :: held 2.619s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:14:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1d37e14e-27fb-4db5-9355-84175ecea1ac tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "cinder-quobyte-151b7bec-6b29-4f0b-8ad9-22f7752885cb" released by "delete_snapshot" :: held 2.657s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:14:36 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:SELECT=78,cinder:INSERT=32,cinder:UPDATE=110,cinder:DELETE=11 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:14:36 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-1d37e14e-27fb-4db5-9355-84175ecea1ac tempest-VolumesSnapshotListTestJSON-1113673011 None] Created reservations ['12227a77-a348-4e45-8172-5f6f2f1ed2f7', '2b94e40d-1fc7-4f56-bea0-838baadfe783', '61ac19cd-b1a7-4822-bd3d-2c026fd50a00', '486b1fb4-5ba8-4533-b1fc-e6c40d14f827'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:14:36 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-1d37e14e-27fb-4db5-9355-84175ecea1ac tempest-VolumesSnapshotListTestJSON-1113673011 None] Delete snapshot completed successfully. Apr 27 10:14:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1d37e14e-27fb-4db5-9355-84175ecea1ac tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "cinder-640f1a71-da7b-4461-8540-0692a8e63be9-delete_snapshot" released by "delete_snapshot" :: held 2.829s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:14:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-73dfd775-bc79-4c54-9926-c5548e07f70b tempest-VolumesSnapshotListTestJSON-1113673011 None] Acquiring lock "cinder-faa97e1f-75fb-4257-954f-d96fc58c38b1-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:14:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-73dfd775-bc79-4c54-9926-c5548e07f70b tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "cinder-faa97e1f-75fb-4257-954f-d96fc58c38b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:14:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-73dfd775-bc79-4c54-9926-c5548e07f70b tempest-VolumesSnapshotListTestJSON-1113673011 None] Acquiring lock "cinder-quobyte-151b7bec-6b29-4f0b-8ad9-22f7752885cb" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:14:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-73dfd775-bc79-4c54-9926-c5548e07f70b tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "cinder-quobyte-151b7bec-6b29-4f0b-8ad9-22f7752885cb" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:14:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-73dfd775-bc79-4c54-9926-c5548e07f70b tempest-VolumesSnapshotListTestJSON-1113673011 None] Acquiring lock "cinder-quobyte-faa97e1f-75fb-4257-954f-d96fc58c38b1" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:14:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-73dfd775-bc79-4c54-9926-c5548e07f70b tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "cinder-quobyte-faa97e1f-75fb-4257-954f-d96fc58c38b1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:14:37 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-73dfd775-bc79-4c54-9926-c5548e07f70b tempest-VolumesSnapshotListTestJSON-1113673011 None] Deleting offline snapshot faa97e1f-75fb-4257-954f-d96fc58c38b1 of volume 151b7bec-6b29-4f0b-8ad9-22f7752885cb {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:14:37 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-73dfd775-bc79-4c54-9926-c5548e07f70b tempest-VolumesSnapshotListTestJSON-1113673011 None] snapshot_file for this snap is: volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:14:37 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[92036b11-21c7-4119-8ac1-3f85a1270855]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:14:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-73dfd775-bc79-4c54-9926-c5548e07f70b tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:37 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1 Apr 27 10:14:37 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:37 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-73dfd775-bc79-4c54-9926-c5548e07f70b tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1" returned: 0 in 0.587s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:37 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-73dfd775-bc79-4c54-9926-c5548e07f70b tempest-VolumesSnapshotListTestJSON-1113673011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:14:37 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[48987df6-15d8-45c5-82a5-457ea0bcdf88]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:14:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-73dfd775-bc79-4c54-9926-c5548e07f70b tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:38 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb Apr 27 10:14:38 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:38 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-73dfd775-bc79-4c54-9926-c5548e07f70b tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb" returned: 0 in 0.588s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-73dfd775-bc79-4c54-9926-c5548e07f70b tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:38 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1 Apr 27 10:14:38 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:38 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:14:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Flow 'volume_create_manager' (04940b5e-b7a0-4d5e-ba08-0ea05ce8ef02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:14:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8952d0be-eb30-41a8-93dd-2ebcf12332ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8952d0be-eb30-41a8-93dd-2ebcf12332ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1705726829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77cc24ed-364c-4772-8076-e14c1b3ef89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4e25e1d6ff4ae7831aaadd483849ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:14:39Z,use_quota=True,user_id='908413b847d14ddf987fabd3fbfb2cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8803337-0a0c-4d1a-9f88-81d24a68594f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8803337-0a0c-4d1a-9f88-81d24a68594f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913fd21c-4d20-4342-99f6-1eeff1b44f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913fd21c-4d20-4342-99f6-1eeff1b44f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77cc24ed-364c-4772-8076-e14c1b3ef89f', 'volume_name': 'volume-77cc24ed-364c-4772-8076-e14c1b3ef89f', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b89a9f6-e3e3-40c4-bb37-c4c5776cf804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b89a9f6-e3e3-40c4-bb37-c4c5776cf804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:38 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb19106-8a94-4df1-9602-856a5cb3a6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:38 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Volume 77cc24ed-364c-4772-8076-e14c1b3ef89f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77cc24ed-364c-4772-8076-e14c1b3ef89f', 'volume_size': 1} Apr 27 10:14:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:14:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:14:38 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1705726829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77cc24ed-364c-4772-8076-e14c1b3ef89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4e25e1d6ff4ae7831aaadd483849ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:14:39Z,use_quota=True,user_id='908413b847d14ddf987fabd3fbfb2cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:14:38 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Creating volume 77cc24ed-364c-4772-8076-e14c1b3ef89f {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:14:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:14:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:14:38 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:14:38 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:14:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:14:38 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:14:38 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:14:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-77cc24ed-364c-4772-8076-e14c1b3ef89f 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:38 devstack sudo[89400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-77cc24ed-364c-4772-8076-e14c1b3ef89f 1073741824 Apr 27 10:14:38 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:39 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-73dfd775-bc79-4c54-9926-c5548e07f70b tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1" returned: 0 in 0.685s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-73dfd775-bc79-4c54-9926-c5548e07f70b tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:39 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1 Apr 27 10:14:39 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:39 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-77cc24ed-364c-4772-8076-e14c1b3ef89f 1073741824" returned: 0 in 0.632s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-77cc24ed-364c-4772-8076-e14c1b3ef89f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:39 devstack sudo[89410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-77cc24ed-364c-4772-8076-e14c1b3ef89f Apr 27 10:14:39 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:39 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-73dfd775-bc79-4c54-9926-c5548e07f70b tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb.faa97e1f-75fb-4257-954f-d96fc58c38b1" returned: 0 in 0.498s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-73dfd775-bc79-4c54-9926-c5548e07f70b tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "cinder-quobyte-faa97e1f-75fb-4257-954f-d96fc58c38b1" released by "_delete_snapshot" :: held 2.524s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:14:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-73dfd775-bc79-4c54-9926-c5548e07f70b tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "cinder-quobyte-151b7bec-6b29-4f0b-8ad9-22f7752885cb" released by "delete_snapshot" :: held 2.555s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:14:39 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-73dfd775-bc79-4c54-9926-c5548e07f70b tempest-VolumesSnapshotListTestJSON-1113673011 None] Created reservations ['b407cb8c-fbf9-4d7f-bdbf-e601d574de5b', '7422114f-4cd1-4faf-b279-878871aaf5d4', 'b9d815d5-bbda-45d6-9657-54cdd70ce514', 'bafa88ac-39fb-491a-beca-8afce0f071a6'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:14:39 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-73dfd775-bc79-4c54-9926-c5548e07f70b tempest-VolumesSnapshotListTestJSON-1113673011 None] Delete snapshot completed successfully. Apr 27 10:14:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-73dfd775-bc79-4c54-9926-c5548e07f70b tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "cinder-faa97e1f-75fb-4257-954f-d96fc58c38b1-delete_snapshot" released by "delete_snapshot" :: held 2.704s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:14:40 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-77cc24ed-364c-4772-8076-e14c1b3ef89f" returned: 0 in 0.473s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:40 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:14:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:14:40 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb19106-8a94-4df1-9602-856a5cb3a6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77cc24ed-364c-4772-8076-e14c1b3ef89f', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:40 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccbc5cc1-f0f5-4dc1-8cfd-845e29e80e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:40 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Volume volume-77cc24ed-364c-4772-8076-e14c1b3ef89f (77cc24ed-364c-4772-8076-e14c1b3ef89f): created successfully Apr 27 10:14:40 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccbc5cc1-f0f5-4dc1-8cfd-845e29e80e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:40 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Flow 'volume_create_manager' (04940b5e-b7a0-4d5e-ba08-0ea05ce8ef02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:14:40 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-03fccee4-93bc-49e1-8be8-c1ed5cded978 tempest-VolumesActionsTest-565677493 None] Created volume successfully. Apr 27 10:14:40 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ce8e2631-d4e4-4b6b-91cc-7492da5d3d67 tempest-VolumesSnapshotListTestJSON-1113673011 None] Acquiring lock "cinder-151b7bec-6b29-4f0b-8ad9-22f7752885cb-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:14:40 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ce8e2631-d4e4-4b6b-91cc-7492da5d3d67 tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "cinder-151b7bec-6b29-4f0b-8ad9-22f7752885cb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:14:40 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ce8e2631-d4e4-4b6b-91cc-7492da5d3d67 tempest-VolumesSnapshotListTestJSON-1113673011 None] Acquiring lock "cinder-quobyte-151b7bec-6b29-4f0b-8ad9-22f7752885cb" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:14:40 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ce8e2631-d4e4-4b6b-91cc-7492da5d3d67 tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "cinder-quobyte-151b7bec-6b29-4f0b-8ad9-22f7752885cb" acquired by "delete_volume" :: waited 0.019s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:14:40 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[044fadb4-0389-4c60-9429-fa9cd28bf9eb]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:14:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ce8e2631-d4e4-4b6b-91cc-7492da5d3d67 tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:40 devstack sudo[89414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb Apr 27 10:14:40 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:40 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5355eb2a-8204-4546-821a-63bdb5425e93 tempest-VolumesActionsTest-565677493 None] Acquiring lock "cinder-77cc24ed-364c-4772-8076-e14c1b3ef89f" by "attach_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:14:40 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5355eb2a-8204-4546-821a-63bdb5425e93 tempest-VolumesActionsTest-565677493 None] Lock "cinder-77cc24ed-364c-4772-8076-e14c1b3ef89f" acquired by "attach_volume" :: waited 0.021s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:14:40 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-5355eb2a-8204-4546-821a-63bdb5425e93 tempest-VolumesActionsTest-565677493 None] Attaching volume 77cc24ed-364c-4772-8076-e14c1b3ef89f to instance b2cc8322-391e-4401-bdbf-8f82cf40cb2f at mountpoint /dev/vdb on host None. Apr 27 10:14:41 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-5355eb2a-8204-4546-821a-63bdb5425e93 tempest-VolumesActionsTest-565677493 None] Attach volume completed successfully. Apr 27 10:14:41 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5355eb2a-8204-4546-821a-63bdb5425e93 tempest-VolumesActionsTest-565677493 None] Lock "cinder-77cc24ed-364c-4772-8076-e14c1b3ef89f" released by "attach_volume" :: held 0.091s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:14:41 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ce8e2631-d4e4-4b6b-91cc-7492da5d3d67 tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb" returned: 0 in 0.574s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ce8e2631-d4e4-4b6b-91cc-7492da5d3d67 tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:41 devstack sudo[89419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb Apr 27 10:14:41 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:41 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ce8e2631-d4e4-4b6b-91cc-7492da5d3d67 tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-151b7bec-6b29-4f0b-8ad9-22f7752885cb" returned: 0 in 0.488s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:41 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ce8e2631-d4e4-4b6b-91cc-7492da5d3d67 tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "cinder-quobyte-151b7bec-6b29-4f0b-8ad9-22f7752885cb" released by "delete_volume" :: held 1.152s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:14:41 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-ce8e2631-d4e4-4b6b-91cc-7492da5d3d67 tempest-VolumesSnapshotListTestJSON-1113673011 None] Created reservations ['b5027164-1bef-4d38-bbbc-d780f3648189', 'e16d166a-06f5-4ca8-9c48-cd3c4bb9b41f', '9e2a38ee-8313-4c69-9d15-d8c47485895f', 'df77d1f3-1ed8-4144-9165-f314493ab873'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:14:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ce8e2631-d4e4-4b6b-91cc-7492da5d3d67 tempest-VolumesSnapshotListTestJSON-1113673011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:14:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ce8e2631-d4e4-4b6b-91cc-7492da5d3d67 tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:14:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ce8e2631-d4e4-4b6b-91cc-7492da5d3d67 tempest-VolumesSnapshotListTestJSON-1113673011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:14:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ce8e2631-d4e4-4b6b-91cc-7492da5d3d67 tempest-VolumesSnapshotListTestJSON-1113673011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:14:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ce8e2631-d4e4-4b6b-91cc-7492da5d3d67 tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:14:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ce8e2631-d4e4-4b6b-91cc-7492da5d3d67 tempest-VolumesSnapshotListTestJSON-1113673011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:41 devstack sudo[89422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:14:41 devstack sudo[89422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:41 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-e64a38e1-419f-4ffd-848a-2451dec42e80 tempest-VolumesActionsTest-215132582 None] Terminate volume connection completed successfully. Apr 27 10:14:42 devstack sudo[89422]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ce8e2631-d4e4-4b6b-91cc-7492da5d3d67 tempest-VolumesSnapshotListTestJSON-1113673011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.543s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:42 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-ce8e2631-d4e4-4b6b-91cc-7492da5d3d67 tempest-VolumesSnapshotListTestJSON-1113673011 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:14:42 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-ce8e2631-d4e4-4b6b-91cc-7492da5d3d67 tempest-VolumesSnapshotListTestJSON-1113673011 None] Deleted volume successfully. Apr 27 10:14:42 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ce8e2631-d4e4-4b6b-91cc-7492da5d3d67 tempest-VolumesSnapshotListTestJSON-1113673011 None] Lock "cinder-151b7bec-6b29-4f0b-8ad9-22f7752885cb-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:14:42 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e64a38e1-419f-4ffd-848a-2451dec42e80 tempest-VolumesActionsTest-215132582 None] Acquiring lock "cinder-77cc24ed-364c-4772-8076-e14c1b3ef89f-detach_volume" by "detach_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:14:42 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e64a38e1-419f-4ffd-848a-2451dec42e80 tempest-VolumesActionsTest-215132582 None] Lock "cinder-77cc24ed-364c-4772-8076-e14c1b3ef89f-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:14:42 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-e64a38e1-419f-4ffd-848a-2451dec42e80 tempest-VolumesActionsTest-215132582 None] Detaching volume 77cc24ed-364c-4772-8076-e14c1b3ef89f from instance b2cc8322-391e-4401-bdbf-8f82cf40cb2f. Apr 27 10:14:42 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-e64a38e1-419f-4ffd-848a-2451dec42e80 tempest-VolumesActionsTest-215132582 None] Detach volume completed successfully. Apr 27 10:14:42 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e64a38e1-419f-4ffd-848a-2451dec42e80 tempest-VolumesActionsTest-215132582 None] Lock "cinder-77cc24ed-364c-4772-8076-e14c1b3ef89f-detach_volume" released by "detach_volume" :: held 0.078s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:14:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-6b2588fe-108a-45ee-9288-229b793776e5 tempest-VolumesActionsTest-565677493 None] Acquiring lock "cinder-77cc24ed-364c-4772-8076-e14c1b3ef89f-detach_volume" by "detach_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:14:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-6b2588fe-108a-45ee-9288-229b793776e5 tempest-VolumesActionsTest-565677493 None] Lock "cinder-77cc24ed-364c-4772-8076-e14c1b3ef89f-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:14:43 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-6b2588fe-108a-45ee-9288-229b793776e5 tempest-VolumesActionsTest-565677493 None] Volume detach called, but volume not attached. Apr 27 10:14:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-6b2588fe-108a-45ee-9288-229b793776e5 tempest-VolumesActionsTest-565677493 None] Lock "cinder-77cc24ed-364c-4772-8076-e14c1b3ef89f-detach_volume" released by "detach_volume" :: held 0.026s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:14:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-f402c869-c227-4923-8223-49fd31b49eca tempest-VolumesActionsTest-565677493 None] Acquiring lock "cinder-77cc24ed-364c-4772-8076-e14c1b3ef89f-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:14:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-f402c869-c227-4923-8223-49fd31b49eca tempest-VolumesActionsTest-565677493 None] Lock "cinder-77cc24ed-364c-4772-8076-e14c1b3ef89f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:14:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-f402c869-c227-4923-8223-49fd31b49eca tempest-VolumesActionsTest-565677493 None] Acquiring lock "cinder-quobyte-77cc24ed-364c-4772-8076-e14c1b3ef89f" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:14:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-f402c869-c227-4923-8223-49fd31b49eca tempest-VolumesActionsTest-565677493 None] Lock "cinder-quobyte-77cc24ed-364c-4772-8076-e14c1b3ef89f" acquired by "delete_volume" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:14:44 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb8ade8-d4ed-48a2-bb4f-8451a6cecf1a]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:14:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f402c869-c227-4923-8223-49fd31b49eca tempest-VolumesActionsTest-565677493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-77cc24ed-364c-4772-8076-e14c1b3ef89f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:44 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-77cc24ed-364c-4772-8076-e14c1b3ef89f Apr 27 10:14:44 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:44 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f402c869-c227-4923-8223-49fd31b49eca tempest-VolumesActionsTest-565677493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-77cc24ed-364c-4772-8076-e14c1b3ef89f" returned: 0 in 0.561s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f402c869-c227-4923-8223-49fd31b49eca tempest-VolumesActionsTest-565677493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-77cc24ed-364c-4772-8076-e14c1b3ef89f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:44 devstack sudo[89430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-77cc24ed-364c-4772-8076-e14c1b3ef89f Apr 27 10:14:44 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:45 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f402c869-c227-4923-8223-49fd31b49eca tempest-VolumesActionsTest-565677493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-77cc24ed-364c-4772-8076-e14c1b3ef89f" returned: 0 in 0.426s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:45 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-f402c869-c227-4923-8223-49fd31b49eca tempest-VolumesActionsTest-565677493 None] Lock "cinder-quobyte-77cc24ed-364c-4772-8076-e14c1b3ef89f" released by "delete_volume" :: held 1.040s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:14:45 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-f402c869-c227-4923-8223-49fd31b49eca tempest-VolumesActionsTest-565677493 None] Created reservations ['44af1c2d-cfe2-4e33-9354-378da749a028', '386ca3b8-3b27-4e7e-9264-3f6926932cb9', 'f34f6a0c-1633-4577-90a9-d474b665bb55', 'c6cb7d5f-60b7-4429-b27d-beed344375e9'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:14:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f402c869-c227-4923-8223-49fd31b49eca tempest-VolumesActionsTest-565677493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:14:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f402c869-c227-4923-8223-49fd31b49eca tempest-VolumesActionsTest-565677493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:14:45 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f402c869-c227-4923-8223-49fd31b49eca tempest-VolumesActionsTest-565677493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:14:45 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f402c869-c227-4923-8223-49fd31b49eca tempest-VolumesActionsTest-565677493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:14:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f402c869-c227-4923-8223-49fd31b49eca tempest-VolumesActionsTest-565677493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:14:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f402c869-c227-4923-8223-49fd31b49eca tempest-VolumesActionsTest-565677493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:45 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:14:45 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:45 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f402c869-c227-4923-8223-49fd31b49eca tempest-VolumesActionsTest-565677493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.476s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:45 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-f402c869-c227-4923-8223-49fd31b49eca tempest-VolumesActionsTest-565677493 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:14:45 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-f402c869-c227-4923-8223-49fd31b49eca tempest-VolumesActionsTest-565677493 None] Deleted volume successfully. Apr 27 10:14:45 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-f402c869-c227-4923-8223-49fd31b49eca tempest-VolumesActionsTest-565677493 None] Lock "cinder-77cc24ed-364c-4772-8076-e14c1b3ef89f-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:14:53 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:14:53 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Flow 'volume_create_manager' (4f498de6-7748-4f59-be13-cf7fc9caf561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:14:53 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26fe0fe5-6852-4ec2-bc96-65493f6a5b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:53 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26fe0fe5-6852-4ec2-bc96-65493f6a5b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1975290084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db2fd5a-5142-4128-beca-9a30e483f7f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4e25e1d6ff4ae7831aaadd483849ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:14:54Z,use_quota=True,user_id='908413b847d14ddf987fabd3fbfb2cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:53 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cce480e-e6cd-4ba2-9f70-9677bfaf58a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:53 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cce480e-e6cd-4ba2-9f70-9677bfaf58a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:53 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df3b474-33ee-41c9-a6d1-8bbb319c4786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:53 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df3b474-33ee-41c9-a6d1-8bbb319c4786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8db2fd5a-5142-4128-beca-9a30e483f7f4', 'volume_name': 'volume-8db2fd5a-5142-4128-beca-9a30e483f7f4', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:53 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9827e687-127e-4716-9db8-3291c65f7dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:53 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9827e687-127e-4716-9db8-3291c65f7dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:53 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36820b9b-756f-40e4-b67f-31006447ea2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:53 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Volume 8db2fd5a-5142-4128-beca-9a30e483f7f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8db2fd5a-5142-4128-beca-9a30e483f7f4', 'volume_size': 1} Apr 27 10:14:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:14:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:14:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1975290084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db2fd5a-5142-4128-beca-9a30e483f7f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4e25e1d6ff4ae7831aaadd483849ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:14:54Z,use_quota=True,user_id='908413b847d14ddf987fabd3fbfb2cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:14:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Creating volume 8db2fd5a-5142-4128-beca-9a30e483f7f4 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:14:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:14:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:14:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:14:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:14:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:14:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:14:53 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:14:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8db2fd5a-5142-4128-beca-9a30e483f7f4 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:53 devstack sudo[89467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8db2fd5a-5142-4128-beca-9a30e483f7f4 1073741824 Apr 27 10:14:53 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:54 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8db2fd5a-5142-4128-beca-9a30e483f7f4 1073741824" returned: 0 in 0.596s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8db2fd5a-5142-4128-beca-9a30e483f7f4 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:54 devstack sudo[89472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8db2fd5a-5142-4128-beca-9a30e483f7f4 Apr 27 10:14:54 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:54 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8db2fd5a-5142-4128-beca-9a30e483f7f4" returned: 0 in 0.436s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:14:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:14:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36820b9b-756f-40e4-b67f-31006447ea2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8db2fd5a-5142-4128-beca-9a30e483f7f4', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2ce89a-f644-4a22-8687-6a8c69c6c3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:54 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Volume volume-8db2fd5a-5142-4128-beca-9a30e483f7f4 (8db2fd5a-5142-4128-beca-9a30e483f7f4): created successfully Apr 27 10:14:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2ce89a-f644-4a22-8687-6a8c69c6c3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Flow 'volume_create_manager' (4f498de6-7748-4f59-be13-cf7fc9caf561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:14:54 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-c0c6b9ab-a3b0-424b-a8f4-6880df09cb56 tempest-VolumesActionsTest-565677493 None] Created volume successfully. Apr 27 10:14:55 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-13e03424-2174-45e5-ba66-4ac736d3f465 tempest-VolumesActionsTest-215132582 None] Acquiring lock "cinder-8db2fd5a-5142-4128-beca-9a30e483f7f4-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:14:56 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-13e03424-2174-45e5-ba66-4ac736d3f465 tempest-VolumesActionsTest-215132582 None] Lock "cinder-8db2fd5a-5142-4128-beca-9a30e483f7f4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:14:56 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-13e03424-2174-45e5-ba66-4ac736d3f465 tempest-VolumesActionsTest-215132582 None] Acquiring lock "cinder-quobyte-8db2fd5a-5142-4128-beca-9a30e483f7f4" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:14:56 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-13e03424-2174-45e5-ba66-4ac736d3f465 tempest-VolumesActionsTest-215132582 None] Lock "cinder-quobyte-8db2fd5a-5142-4128-beca-9a30e483f7f4" acquired by "delete_volume" :: waited 0.014s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:14:56 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[52400c92-121f-425f-ab42-c5aaa041c2bb]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:14:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-13e03424-2174-45e5-ba66-4ac736d3f465 tempest-VolumesActionsTest-215132582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8db2fd5a-5142-4128-beca-9a30e483f7f4 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:56 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8db2fd5a-5142-4128-beca-9a30e483f7f4 Apr 27 10:14:56 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:56 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-13e03424-2174-45e5-ba66-4ac736d3f465 tempest-VolumesActionsTest-215132582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8db2fd5a-5142-4128-beca-9a30e483f7f4" returned: 0 in 0.511s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-13e03424-2174-45e5-ba66-4ac736d3f465 tempest-VolumesActionsTest-215132582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8db2fd5a-5142-4128-beca-9a30e483f7f4 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:56 devstack sudo[89481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8db2fd5a-5142-4128-beca-9a30e483f7f4 Apr 27 10:14:56 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:57 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-13e03424-2174-45e5-ba66-4ac736d3f465 tempest-VolumesActionsTest-215132582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-8db2fd5a-5142-4128-beca-9a30e483f7f4" returned: 0 in 0.447s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:57 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-13e03424-2174-45e5-ba66-4ac736d3f465 tempest-VolumesActionsTest-215132582 None] Lock "cinder-quobyte-8db2fd5a-5142-4128-beca-9a30e483f7f4" released by "delete_volume" :: held 0.997s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:14:57 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-13e03424-2174-45e5-ba66-4ac736d3f465 tempest-VolumesActionsTest-215132582 None] Created reservations ['abd9b3da-e6f2-4d39-95e2-e788347a7c02', 'c4efe050-d187-4bf5-9911-7e0fc242eb52', 'e6972f79-fa57-4b54-818a-95cf69dacadb', '3f5515e6-29c2-4572-91ba-44ffcdf05e6e'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:14:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-13e03424-2174-45e5-ba66-4ac736d3f465 tempest-VolumesActionsTest-215132582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:14:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-13e03424-2174-45e5-ba66-4ac736d3f465 tempest-VolumesActionsTest-215132582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:14:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-13e03424-2174-45e5-ba66-4ac736d3f465 tempest-VolumesActionsTest-215132582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:14:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-13e03424-2174-45e5-ba66-4ac736d3f465 tempest-VolumesActionsTest-215132582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:14:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-13e03424-2174-45e5-ba66-4ac736d3f465 tempest-VolumesActionsTest-215132582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:14:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-13e03424-2174-45e5-ba66-4ac736d3f465 tempest-VolumesActionsTest-215132582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:57 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:14:57 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:57 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-13e03424-2174-45e5-ba66-4ac736d3f465 tempest-VolumesActionsTest-215132582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.436s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:57 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-13e03424-2174-45e5-ba66-4ac736d3f465 tempest-VolumesActionsTest-215132582 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:14:57 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-13e03424-2174-45e5-ba66-4ac736d3f465 tempest-VolumesActionsTest-215132582 None] Deleted volume successfully. Apr 27 10:14:57 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-13e03424-2174-45e5-ba66-4ac736d3f465 tempest-VolumesActionsTest-215132582 None] Lock "cinder-8db2fd5a-5142-4128-beca-9a30e483f7f4-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:14:58 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:14:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Flow 'volume_create_manager' (5d1add12-1adb-4854-b699-9465d097e9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:14:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a79bf0-bd1b-4563-9dd4-ebdc177deb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a79bf0-bd1b-4563-9dd4-ebdc177deb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1361325999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4187c578-8b3f-475e-b67c-838bd3c46957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4e25e1d6ff4ae7831aaadd483849ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:14:58Z,use_quota=True,user_id='908413b847d14ddf987fabd3fbfb2cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091d33de-06dc-4730-ad4c-307ee69b04ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091d33de-06dc-4730-ad4c-307ee69b04ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a6fce97-8315-4cc9-832b-186c534b1c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a6fce97-8315-4cc9-832b-186c534b1c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4187c578-8b3f-475e-b67c-838bd3c46957', 'volume_name': 'volume-4187c578-8b3f-475e-b67c-838bd3c46957', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebe8940-7431-43d5-ad27-56d3efa286e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebe8940-7431-43d5-ad27-56d3efa286e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b5bdac-6ca3-4224-bf51-d50625338e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:58 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Volume 4187c578-8b3f-475e-b67c-838bd3c46957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4187c578-8b3f-475e-b67c-838bd3c46957', 'volume_size': 1} Apr 27 10:14:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:14:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:14:58 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1361325999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4187c578-8b3f-475e-b67c-838bd3c46957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4e25e1d6ff4ae7831aaadd483849ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:14:58Z,use_quota=True,user_id='908413b847d14ddf987fabd3fbfb2cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:14:58 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Creating volume 4187c578-8b3f-475e-b67c-838bd3c46957 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:14:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:14:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:14:58 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:14:58 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:14:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:14:58 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:14:58 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:14:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4187c578-8b3f-475e-b67c-838bd3c46957 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:58 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4187c578-8b3f-475e-b67c-838bd3c46957 1073741824 Apr 27 10:14:58 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:59 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4187c578-8b3f-475e-b67c-838bd3c46957 1073741824" returned: 0 in 0.617s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4187c578-8b3f-475e-b67c-838bd3c46957 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:14:59 devstack sudo[89526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4187c578-8b3f-475e-b67c-838bd3c46957 Apr 27 10:14:59 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:14:59 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root Apr 27 10:14:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4187c578-8b3f-475e-b67c-838bd3c46957" returned: 0 in 0.440s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:14:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:14:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:14:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b5bdac-6ca3-4224-bf51-d50625338e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4187c578-8b3f-475e-b67c-838bd3c46957', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da666539-8952-4e79-a171-90b7ccc1635c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:14:59 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Volume volume-4187c578-8b3f-475e-b67c-838bd3c46957 (4187c578-8b3f-475e-b67c-838bd3c46957): created successfully Apr 27 10:14:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da666539-8952-4e79-a171-90b7ccc1635c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:14:59 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Flow 'volume_create_manager' (5d1add12-1adb-4854-b699-9465d097e9d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:14:59 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-adc7d179-af0e-48a6-8019-a6b209c5068b tempest-VolumesActionsTest-565677493 None] Created volume successfully. Apr 27 10:15:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a2d6fbac-ff39-4b92-9a51-6015497febc5 tempest-VolumesActionsTest-215132582 None] Acquiring lock "cinder-4187c578-8b3f-475e-b67c-838bd3c46957-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:15:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a2d6fbac-ff39-4b92-9a51-6015497febc5 tempest-VolumesActionsTest-215132582 None] Lock "cinder-4187c578-8b3f-475e-b67c-838bd3c46957-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:15:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a2d6fbac-ff39-4b92-9a51-6015497febc5 tempest-VolumesActionsTest-215132582 None] Acquiring lock "cinder-quobyte-4187c578-8b3f-475e-b67c-838bd3c46957" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:15:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a2d6fbac-ff39-4b92-9a51-6015497febc5 tempest-VolumesActionsTest-215132582 None] Lock "cinder-quobyte-4187c578-8b3f-475e-b67c-838bd3c46957" acquired by "delete_volume" :: waited 0.014s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:15:00 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[161b1aa0-5cc1-434d-87b1-39436633b048]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:15:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a2d6fbac-ff39-4b92-9a51-6015497febc5 tempest-VolumesActionsTest-215132582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4187c578-8b3f-475e-b67c-838bd3c46957 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:00 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4187c578-8b3f-475e-b67c-838bd3c46957 Apr 27 10:15:00 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:01 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a2d6fbac-ff39-4b92-9a51-6015497febc5 tempest-VolumesActionsTest-215132582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4187c578-8b3f-475e-b67c-838bd3c46957" returned: 0 in 0.508s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a2d6fbac-ff39-4b92-9a51-6015497febc5 tempest-VolumesActionsTest-215132582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4187c578-8b3f-475e-b67c-838bd3c46957 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:01 devstack sudo[89534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4187c578-8b3f-475e-b67c-838bd3c46957 Apr 27 10:15:01 devstack sudo[89534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:01 devstack sudo[89534]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a2d6fbac-ff39-4b92-9a51-6015497febc5 tempest-VolumesActionsTest-215132582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-4187c578-8b3f-475e-b67c-838bd3c46957" returned: 0 in 0.434s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:01 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a2d6fbac-ff39-4b92-9a51-6015497febc5 tempest-VolumesActionsTest-215132582 None] Lock "cinder-quobyte-4187c578-8b3f-475e-b67c-838bd3c46957" released by "delete_volume" :: held 0.986s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:15:01 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-a2d6fbac-ff39-4b92-9a51-6015497febc5 tempest-VolumesActionsTest-215132582 None] Created reservations ['4abe6d70-be8d-4d26-a341-dccc7f3e4d18', 'eccb6f67-bf17-4206-82b1-03f4b056fa98', 'ff9a936f-0b77-4e49-9b65-111724edd8a3', '06b50169-227a-4a7f-b2ac-4dff359edba3'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:15:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-a2d6fbac-ff39-4b92-9a51-6015497febc5 tempest-VolumesActionsTest-215132582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-a2d6fbac-ff39-4b92-9a51-6015497febc5 tempest-VolumesActionsTest-215132582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-a2d6fbac-ff39-4b92-9a51-6015497febc5 tempest-VolumesActionsTest-215132582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:15:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-a2d6fbac-ff39-4b92-9a51-6015497febc5 tempest-VolumesActionsTest-215132582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:15:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-a2d6fbac-ff39-4b92-9a51-6015497febc5 tempest-VolumesActionsTest-215132582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a2d6fbac-ff39-4b92-9a51-6015497febc5 tempest-VolumesActionsTest-215132582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:02 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:15:02 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:02 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a2d6fbac-ff39-4b92-9a51-6015497febc5 tempest-VolumesActionsTest-215132582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.435s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:02 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-a2d6fbac-ff39-4b92-9a51-6015497febc5 tempest-VolumesActionsTest-215132582 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:15:02 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-a2d6fbac-ff39-4b92-9a51-6015497febc5 tempest-VolumesActionsTest-215132582 None] Deleted volume successfully. Apr 27 10:15:02 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a2d6fbac-ff39-4b92-9a51-6015497febc5 tempest-VolumesActionsTest-215132582 None] Lock "cinder-4187c578-8b3f-475e-b67c-838bd3c46957-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:15:03 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:15:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Flow 'volume_create_manager' (9655e145-20b9-491a-b1c4-323083e1af28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:15:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a62794-85a6-436c-a4ed-b010bf00715b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a62794-85a6-436c-a4ed-b010bf00715b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1862468664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f51339d-8e3f-4a93-90a4-b6a600628f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4e25e1d6ff4ae7831aaadd483849ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:15:03Z,use_quota=True,user_id='908413b847d14ddf987fabd3fbfb2cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea145a3-4843-49ce-a3c0-77529148b115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea145a3-4843-49ce-a3c0-77529148b115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (662fb8d7-5fbf-4a3c-abda-9f801983e1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (662fb8d7-5fbf-4a3c-abda-9f801983e1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f51339d-8e3f-4a93-90a4-b6a600628f20', 'volume_name': 'volume-5f51339d-8e3f-4a93-90a4-b6a600628f20', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a22ffc-2f39-4d2c-9375-3a371ffb0a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a22ffc-2f39-4d2c-9375-3a371ffb0a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:03 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75ca9e1-c393-47c5-b491-eabe08a9dfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:03 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Volume 5f51339d-8e3f-4a93-90a4-b6a600628f20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f51339d-8e3f-4a93-90a4-b6a600628f20', 'volume_size': 1} Apr 27 10:15:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1862468664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f51339d-8e3f-4a93-90a4-b6a600628f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4e25e1d6ff4ae7831aaadd483849ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:15:03Z,use_quota=True,user_id='908413b847d14ddf987fabd3fbfb2cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:15:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Creating volume 5f51339d-8e3f-4a93-90a4-b6a600628f20 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:15:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:15:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:15:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:03 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:15:03 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:15:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5f51339d-8e3f-4a93-90a4-b6a600628f20 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:03 devstack sudo[89540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5f51339d-8e3f-4a93-90a4-b6a600628f20 1073741824 Apr 27 10:15:03 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:04 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5f51339d-8e3f-4a93-90a4-b6a600628f20 1073741824" returned: 0 in 0.656s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5f51339d-8e3f-4a93-90a4-b6a600628f20 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:04 devstack sudo[89545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5f51339d-8e3f-4a93-90a4-b6a600628f20 Apr 27 10:15:04 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:04 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5f51339d-8e3f-4a93-90a4-b6a600628f20" returned: 0 in 0.444s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:04 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:15:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:04 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75ca9e1-c393-47c5-b491-eabe08a9dfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f51339d-8e3f-4a93-90a4-b6a600628f20', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:04 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac68592-394a-4b16-aad7-0fb573dff19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:04 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Volume volume-5f51339d-8e3f-4a93-90a4-b6a600628f20 (5f51339d-8e3f-4a93-90a4-b6a600628f20): created successfully Apr 27 10:15:04 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac68592-394a-4b16-aad7-0fb573dff19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:04 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Flow 'volume_create_manager' (9655e145-20b9-491a-b1c4-323083e1af28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:15:04 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-7cb230c4-1e46-4e27-b676-8c5b3ff74160 tempest-VolumesActionsTest-565677493 None] Created volume successfully. Apr 27 10:15:05 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e5272e65-c18f-462f-97f2-d9a6ccabf463 tempest-VolumesActionsTest-215132582 None] Acquiring lock "cinder-5f51339d-8e3f-4a93-90a4-b6a600628f20-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:15:05 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e5272e65-c18f-462f-97f2-d9a6ccabf463 tempest-VolumesActionsTest-215132582 None] Lock "cinder-5f51339d-8e3f-4a93-90a4-b6a600628f20-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:15:05 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e5272e65-c18f-462f-97f2-d9a6ccabf463 tempest-VolumesActionsTest-215132582 None] Acquiring lock "cinder-quobyte-5f51339d-8e3f-4a93-90a4-b6a600628f20" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:15:05 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e5272e65-c18f-462f-97f2-d9a6ccabf463 tempest-VolumesActionsTest-215132582 None] Lock "cinder-quobyte-5f51339d-8e3f-4a93-90a4-b6a600628f20" acquired by "delete_volume" :: waited 0.017s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:15:05 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffd2de1-ec64-4790-9f31-bc61f034e962]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:15:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e5272e65-c18f-462f-97f2-d9a6ccabf463 tempest-VolumesActionsTest-215132582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5f51339d-8e3f-4a93-90a4-b6a600628f20 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:05 devstack sudo[89549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5f51339d-8e3f-4a93-90a4-b6a600628f20 Apr 27 10:15:05 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:06 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e5272e65-c18f-462f-97f2-d9a6ccabf463 tempest-VolumesActionsTest-215132582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5f51339d-8e3f-4a93-90a4-b6a600628f20" returned: 0 in 0.529s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e5272e65-c18f-462f-97f2-d9a6ccabf463 tempest-VolumesActionsTest-215132582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5f51339d-8e3f-4a93-90a4-b6a600628f20 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:06 devstack sudo[89554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5f51339d-8e3f-4a93-90a4-b6a600628f20 Apr 27 10:15:06 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:06 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e5272e65-c18f-462f-97f2-d9a6ccabf463 tempest-VolumesActionsTest-215132582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5f51339d-8e3f-4a93-90a4-b6a600628f20" returned: 0 in 0.473s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e5272e65-c18f-462f-97f2-d9a6ccabf463 tempest-VolumesActionsTest-215132582 None] Lock "cinder-quobyte-5f51339d-8e3f-4a93-90a4-b6a600628f20" released by "delete_volume" :: held 1.044s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:15:06 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-e5272e65-c18f-462f-97f2-d9a6ccabf463 tempest-VolumesActionsTest-215132582 None] Created reservations ['b4dbd3cc-4e7d-4368-8547-bc3defca04db', '88f2fb2e-ecf9-43ac-bf6f-fcfabf9e3f9b', '69f45970-ec87-4870-bd67-7095b594e093', '5d918451-3ba6-4d7a-821c-6ecaa8aff036'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:15:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e5272e65-c18f-462f-97f2-d9a6ccabf463 tempest-VolumesActionsTest-215132582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e5272e65-c18f-462f-97f2-d9a6ccabf463 tempest-VolumesActionsTest-215132582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:06 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e5272e65-c18f-462f-97f2-d9a6ccabf463 tempest-VolumesActionsTest-215132582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:15:06 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e5272e65-c18f-462f-97f2-d9a6ccabf463 tempest-VolumesActionsTest-215132582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:15:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e5272e65-c18f-462f-97f2-d9a6ccabf463 tempest-VolumesActionsTest-215132582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e5272e65-c18f-462f-97f2-d9a6ccabf463 tempest-VolumesActionsTest-215132582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:06 devstack sudo[89557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:15:06 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:07 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e5272e65-c18f-462f-97f2-d9a6ccabf463 tempest-VolumesActionsTest-215132582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.459s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:07 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-e5272e65-c18f-462f-97f2-d9a6ccabf463 tempest-VolumesActionsTest-215132582 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:15:07 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-e5272e65-c18f-462f-97f2-d9a6ccabf463 tempest-VolumesActionsTest-215132582 None] Deleted volume successfully. Apr 27 10:15:07 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e5272e65-c18f-462f-97f2-d9a6ccabf463 tempest-VolumesActionsTest-215132582 None] Lock "cinder-5f51339d-8e3f-4a93-90a4-b6a600628f20-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:15:08 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:15:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Flow 'volume_create_manager' (954b37df-2fe9-457f-994f-37d2ec969fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:15:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023c7206-99ab-411b-b2c4-6e426c12d48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023c7206-99ab-411b-b2c4-6e426c12d48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-788831282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=959a337d-c8fa-4465-8281-3e5ecf21eedf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4e25e1d6ff4ae7831aaadd483849ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:15:08Z,use_quota=True,user_id='908413b847d14ddf987fabd3fbfb2cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897233fa-5ef0-4911-ac20-9b5c9e8931ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897233fa-5ef0-4911-ac20-9b5c9e8931ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c19a0cd-870a-4b8a-8b02-a683da5c8cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c19a0cd-870a-4b8a-8b02-a683da5c8cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '959a337d-c8fa-4465-8281-3e5ecf21eedf', 'volume_name': 'volume-959a337d-c8fa-4465-8281-3e5ecf21eedf', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8c967f-1317-41ba-9a96-18bbdda2d01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8c967f-1317-41ba-9a96-18bbdda2d01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e7b6b1-db01-4660-9607-e4446ee51d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:08 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Volume 959a337d-c8fa-4465-8281-3e5ecf21eedf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-959a337d-c8fa-4465-8281-3e5ecf21eedf', 'volume_size': 1} Apr 27 10:15:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-788831282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=959a337d-c8fa-4465-8281-3e5ecf21eedf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4e25e1d6ff4ae7831aaadd483849ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:15:08Z,use_quota=True,user_id='908413b847d14ddf987fabd3fbfb2cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:15:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Creating volume 959a337d-c8fa-4465-8281-3e5ecf21eedf {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:15:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:15:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:15:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:15:08 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:15:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-959a337d-c8fa-4465-8281-3e5ecf21eedf 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:08 devstack sudo[89560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-959a337d-c8fa-4465-8281-3e5ecf21eedf 1073741824 Apr 27 10:15:08 devstack sudo[89560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:08 devstack sudo[89560]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-959a337d-c8fa-4465-8281-3e5ecf21eedf 1073741824" returned: 0 in 0.630s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-959a337d-c8fa-4465-8281-3e5ecf21eedf {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:08 devstack sudo[89565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-959a337d-c8fa-4465-8281-3e5ecf21eedf Apr 27 10:15:08 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:09 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-959a337d-c8fa-4465-8281-3e5ecf21eedf" returned: 0 in 0.457s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:09 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:15:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:09 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e7b6b1-db01-4660-9607-e4446ee51d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-959a337d-c8fa-4465-8281-3e5ecf21eedf', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:09 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39fd6dd9-e6f7-4039-986a-dc69ac2c693d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:09 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Volume volume-959a337d-c8fa-4465-8281-3e5ecf21eedf (959a337d-c8fa-4465-8281-3e5ecf21eedf): created successfully Apr 27 10:15:09 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39fd6dd9-e6f7-4039-986a-dc69ac2c693d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:09 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Flow 'volume_create_manager' (954b37df-2fe9-457f-994f-37d2ec969fe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:15:09 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-e97c780b-0c7b-44e3-9335-73a5fa370c0f tempest-VolumesActionsTest-565677493 None] Created volume successfully. Apr 27 10:15:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3f4d5a75-a2ad-43a1-8f0d-a14451e8b6c1 tempest-VolumesActionsTest-215132582 None] Acquiring lock "cinder-959a337d-c8fa-4465-8281-3e5ecf21eedf-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:15:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3f4d5a75-a2ad-43a1-8f0d-a14451e8b6c1 tempest-VolumesActionsTest-215132582 None] Lock "cinder-959a337d-c8fa-4465-8281-3e5ecf21eedf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:15:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3f4d5a75-a2ad-43a1-8f0d-a14451e8b6c1 tempest-VolumesActionsTest-215132582 None] Acquiring lock "cinder-quobyte-959a337d-c8fa-4465-8281-3e5ecf21eedf" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:15:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3f4d5a75-a2ad-43a1-8f0d-a14451e8b6c1 tempest-VolumesActionsTest-215132582 None] Lock "cinder-quobyte-959a337d-c8fa-4465-8281-3e5ecf21eedf" acquired by "delete_volume" :: waited 0.021s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:15:10 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4f9385-b208-447a-a8ed-90e889d13e8d]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:15:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3f4d5a75-a2ad-43a1-8f0d-a14451e8b6c1 tempest-VolumesActionsTest-215132582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-959a337d-c8fa-4465-8281-3e5ecf21eedf {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:10 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-959a337d-c8fa-4465-8281-3e5ecf21eedf Apr 27 10:15:10 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:11 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3f4d5a75-a2ad-43a1-8f0d-a14451e8b6c1 tempest-VolumesActionsTest-215132582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-959a337d-c8fa-4465-8281-3e5ecf21eedf" returned: 0 in 0.530s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3f4d5a75-a2ad-43a1-8f0d-a14451e8b6c1 tempest-VolumesActionsTest-215132582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-959a337d-c8fa-4465-8281-3e5ecf21eedf {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:11 devstack sudo[89573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-959a337d-c8fa-4465-8281-3e5ecf21eedf Apr 27 10:15:11 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:11 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3f4d5a75-a2ad-43a1-8f0d-a14451e8b6c1 tempest-VolumesActionsTest-215132582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-959a337d-c8fa-4465-8281-3e5ecf21eedf" returned: 0 in 0.433s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3f4d5a75-a2ad-43a1-8f0d-a14451e8b6c1 tempest-VolumesActionsTest-215132582 None] Lock "cinder-quobyte-959a337d-c8fa-4465-8281-3e5ecf21eedf" released by "delete_volume" :: held 1.003s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:15:11 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-3f4d5a75-a2ad-43a1-8f0d-a14451e8b6c1 tempest-VolumesActionsTest-215132582 None] Created reservations ['d1bf4590-6205-4587-9773-509f6261f882', '9bea9c9f-0829-4a80-866f-fbf99bdf0532', '7d6d700e-890b-404b-91e4-f6a2ff993cf4', 'ea620be1-bafc-4a1b-80a8-86265e8243a0'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:15:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3f4d5a75-a2ad-43a1-8f0d-a14451e8b6c1 tempest-VolumesActionsTest-215132582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3f4d5a75-a2ad-43a1-8f0d-a14451e8b6c1 tempest-VolumesActionsTest-215132582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:11 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3f4d5a75-a2ad-43a1-8f0d-a14451e8b6c1 tempest-VolumesActionsTest-215132582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:15:11 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3f4d5a75-a2ad-43a1-8f0d-a14451e8b6c1 tempest-VolumesActionsTest-215132582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:15:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3f4d5a75-a2ad-43a1-8f0d-a14451e8b6c1 tempest-VolumesActionsTest-215132582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3f4d5a75-a2ad-43a1-8f0d-a14451e8b6c1 tempest-VolumesActionsTest-215132582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:11 devstack sudo[89576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:15:11 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:12 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3f4d5a75-a2ad-43a1-8f0d-a14451e8b6c1 tempest-VolumesActionsTest-215132582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.450s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:12 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-3f4d5a75-a2ad-43a1-8f0d-a14451e8b6c1 tempest-VolumesActionsTest-215132582 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:15:12 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-3f4d5a75-a2ad-43a1-8f0d-a14451e8b6c1 tempest-VolumesActionsTest-215132582 None] Deleted volume successfully. Apr 27 10:15:12 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3f4d5a75-a2ad-43a1-8f0d-a14451e8b6c1 tempest-VolumesActionsTest-215132582 None] Lock "cinder-959a337d-c8fa-4465-8281-3e5ecf21eedf-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:15:13 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:15:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Flow 'volume_create_manager' (d3f2baa7-8b1e-411b-a1e0-366d323e0d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:15:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8446e77f-a563-4431-8f2e-991a476cf01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8446e77f-a563-4431-8f2e-991a476cf01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-518159346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e180be-8b4a-419d-8f3f-d663e7460208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4e25e1d6ff4ae7831aaadd483849ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:15:13Z,use_quota=True,user_id='908413b847d14ddf987fabd3fbfb2cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf7750b-510a-4b1d-8690-314aec97511b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf7750b-510a-4b1d-8690-314aec97511b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c1af4ef-0062-488d-8c04-6389f7cad3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c1af4ef-0062-488d-8c04-6389f7cad3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17e180be-8b4a-419d-8f3f-d663e7460208', 'volume_name': 'volume-17e180be-8b4a-419d-8f3f-d663e7460208', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1557d8a-dbec-453b-9cdc-b7ac92a4c0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1557d8a-dbec-453b-9cdc-b7ac92a4c0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d98b27-c559-4ca7-aaaa-46bd0fecd905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:13 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Volume 17e180be-8b4a-419d-8f3f-d663e7460208: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17e180be-8b4a-419d-8f3f-d663e7460208', 'volume_size': 1} Apr 27 10:15:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:13 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-518159346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e180be-8b4a-419d-8f3f-d663e7460208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4e25e1d6ff4ae7831aaadd483849ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:15:13Z,use_quota=True,user_id='908413b847d14ddf987fabd3fbfb2cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:15:13 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Creating volume 17e180be-8b4a-419d-8f3f-d663e7460208 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:15:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:13 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:15:13 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:15:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:13 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:15:13 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:15:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-17e180be-8b4a-419d-8f3f-d663e7460208 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:13 devstack sudo[89581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-17e180be-8b4a-419d-8f3f-d663e7460208 1073741824 Apr 27 10:15:13 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:13 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-17e180be-8b4a-419d-8f3f-d663e7460208 1073741824" returned: 0 in 0.609s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-17e180be-8b4a-419d-8f3f-d663e7460208 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:13 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-17e180be-8b4a-419d-8f3f-d663e7460208 Apr 27 10:15:13 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:14 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-17e180be-8b4a-419d-8f3f-d663e7460208" returned: 0 in 0.465s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:15:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:14 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d98b27-c559-4ca7-aaaa-46bd0fecd905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17e180be-8b4a-419d-8f3f-d663e7460208', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:14 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674fcb40-d857-4b93-8bd0-3b7cce7f7f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:14 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Volume volume-17e180be-8b4a-419d-8f3f-d663e7460208 (17e180be-8b4a-419d-8f3f-d663e7460208): created successfully Apr 27 10:15:14 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674fcb40-d857-4b93-8bd0-3b7cce7f7f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:14 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Flow 'volume_create_manager' (d3f2baa7-8b1e-411b-a1e0-366d323e0d21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:15:14 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-e3453477-8889-4282-8740-fc4070513303 tempest-VolumesActionsTest-565677493 None] Created volume successfully. Apr 27 10:15:15 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-424f6f26-6961-4858-87e5-c7c6f5f8133c tempest-VolumesActionsTest-565677493 None] Acquiring lock "cinder-17e180be-8b4a-419d-8f3f-d663e7460208-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:15:15 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-424f6f26-6961-4858-87e5-c7c6f5f8133c tempest-VolumesActionsTest-565677493 None] Lock "cinder-17e180be-8b4a-419d-8f3f-d663e7460208-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:15:15 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-424f6f26-6961-4858-87e5-c7c6f5f8133c tempest-VolumesActionsTest-565677493 None] Acquiring lock "cinder-quobyte-17e180be-8b4a-419d-8f3f-d663e7460208" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:15:15 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-424f6f26-6961-4858-87e5-c7c6f5f8133c tempest-VolumesActionsTest-565677493 None] Lock "cinder-quobyte-17e180be-8b4a-419d-8f3f-d663e7460208" acquired by "delete_volume" :: waited 0.015s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:15:15 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e9ab3d-ffad-4cdc-9969-ea1e0f5d4a41]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:15:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-424f6f26-6961-4858-87e5-c7c6f5f8133c tempest-VolumesActionsTest-565677493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-17e180be-8b4a-419d-8f3f-d663e7460208 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:15 devstack sudo[89597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-17e180be-8b4a-419d-8f3f-d663e7460208 Apr 27 10:15:15 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:16 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-424f6f26-6961-4858-87e5-c7c6f5f8133c tempest-VolumesActionsTest-565677493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-17e180be-8b4a-419d-8f3f-d663e7460208" returned: 0 in 0.513s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-424f6f26-6961-4858-87e5-c7c6f5f8133c tempest-VolumesActionsTest-565677493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-17e180be-8b4a-419d-8f3f-d663e7460208 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:16 devstack sudo[89602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-17e180be-8b4a-419d-8f3f-d663e7460208 Apr 27 10:15:16 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:16 devstack cinder-volume[81350]: DEBUG oslo_service.periodic_task [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81350) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 10:15:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:15:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:15:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:16 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:15:16 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:16 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-424f6f26-6961-4858-87e5-c7c6f5f8133c tempest-VolumesActionsTest-565677493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-17e180be-8b4a-419d-8f3f-d663e7460208" returned: 0 in 0.428s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:16 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-424f6f26-6961-4858-87e5-c7c6f5f8133c tempest-VolumesActionsTest-565677493 None] Lock "cinder-quobyte-17e180be-8b4a-419d-8f3f-d663e7460208" released by "delete_volume" :: held 0.985s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:15:16 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-424f6f26-6961-4858-87e5-c7c6f5f8133c tempest-VolumesActionsTest-565677493 None] Created reservations ['a3f929b8-6089-4c3f-87a9-b7ae1cd11ce3', '043af1f3-c09f-43a9-9a2e-e1a56496079a', '788ac391-90f8-4b6d-a037-fe23a095b929', '7a6bc474-7852-4272-9539-e8ba94a31c8c'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:15:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-424f6f26-6961-4858-87e5-c7c6f5f8133c tempest-VolumesActionsTest-565677493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-424f6f26-6961-4858-87e5-c7c6f5f8133c tempest-VolumesActionsTest-565677493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-424f6f26-6961-4858-87e5-c7c6f5f8133c tempest-VolumesActionsTest-565677493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:15:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-424f6f26-6961-4858-87e5-c7c6f5f8133c tempest-VolumesActionsTest-565677493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:15:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-424f6f26-6961-4858-87e5-c7c6f5f8133c tempest-VolumesActionsTest-565677493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-424f6f26-6961-4858-87e5-c7c6f5f8133c tempest-VolumesActionsTest-565677493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:16 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:15:16 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:17 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.465s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:17 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:15:17 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-424f6f26-6961-4858-87e5-c7c6f5f8133c tempest-VolumesActionsTest-565677493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.433s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:17 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-424f6f26-6961-4858-87e5-c7c6f5f8133c tempest-VolumesActionsTest-565677493 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:15:17 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-424f6f26-6961-4858-87e5-c7c6f5f8133c tempest-VolumesActionsTest-565677493 None] Deleted volume successfully. Apr 27 10:15:17 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-424f6f26-6961-4858-87e5-c7c6f5f8133c tempest-VolumesActionsTest-565677493 None] Lock "cinder-17e180be-8b4a-419d-8f3f-d663e7460208-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:15:26 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:15:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Flow 'volume_create_manager' (4f9fbc0e-d150-4991-976d-a0af6c61bd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:15:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddaf2dee-4559-4403-8d12-40e10f98f593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddaf2dee-4559-4403-8d12-40e10f98f593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-80029510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061cac20-7032-4709-8c8d-e8c3e83fcd5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de9b56e77af4b888bad3fc3bca386a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:15:26Z,use_quota=True,user_id='794d88c7e19a462e94e6d60af4df635d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c115e6df-7187-4d0a-b79a-8043406428cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c115e6df-7187-4d0a-b79a-8043406428cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f39e05bc-1bde-453c-9ee9-ac6696bae5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f39e05bc-1bde-453c-9ee9-ac6696bae5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '061cac20-7032-4709-8c8d-e8c3e83fcd5a', 'volume_name': 'volume-061cac20-7032-4709-8c8d-e8c3e83fcd5a', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c673ab-91f4-444a-860b-a4a1cd2e7973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c673ab-91f4-444a-860b-a4a1cd2e7973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5efede1-25fe-4f1f-8bcc-007132b056ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:26 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Volume 061cac20-7032-4709-8c8d-e8c3e83fcd5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-061cac20-7032-4709-8c8d-e8c3e83fcd5a', 'volume_size': 1} Apr 27 10:15:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-80029510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061cac20-7032-4709-8c8d-e8c3e83fcd5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de9b56e77af4b888bad3fc3bca386a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:15:26Z,use_quota=True,user_id='794d88c7e19a462e94e6d60af4df635d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:15:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Creating volume 061cac20-7032-4709-8c8d-e8c3e83fcd5a {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:15:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:15:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:15:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:15:26 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:15:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-061cac20-7032-4709-8c8d-e8c3e83fcd5a 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:26 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-061cac20-7032-4709-8c8d-e8c3e83fcd5a 1073741824 Apr 27 10:15:26 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:27 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-061cac20-7032-4709-8c8d-e8c3e83fcd5a 1073741824" returned: 0 in 0.586s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-061cac20-7032-4709-8c8d-e8c3e83fcd5a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:27 devstack sudo[89622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-061cac20-7032-4709-8c8d-e8c3e83fcd5a Apr 27 10:15:27 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:27 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-061cac20-7032-4709-8c8d-e8c3e83fcd5a" returned: 0 in 0.443s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:27 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:15:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5efede1-25fe-4f1f-8bcc-007132b056ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-061cac20-7032-4709-8c8d-e8c3e83fcd5a', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2021adfb-66db-410c-8e3d-bddb5d4dc4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:27 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Volume volume-061cac20-7032-4709-8c8d-e8c3e83fcd5a (061cac20-7032-4709-8c8d-e8c3e83fcd5a): created successfully Apr 27 10:15:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2021adfb-66db-410c-8e3d-bddb5d4dc4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:27 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Flow 'volume_create_manager' (4f9fbc0e-d150-4991-976d-a0af6c61bd09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:15:27 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-8fde1d39-6377-44fe-a31b-fd8b16a78605 tempest-VolumesMetadataTest-898939916 None] Created volume successfully. Apr 27 10:15:29 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2864b8e-fb2c-4009-92fd-f37c12b30ddd tempest-VolumesMetadataTest-898939916 None] Acquiring lock "cinder-061cac20-7032-4709-8c8d-e8c3e83fcd5a-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:15:29 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2864b8e-fb2c-4009-92fd-f37c12b30ddd tempest-VolumesMetadataTest-898939916 None] Lock "cinder-061cac20-7032-4709-8c8d-e8c3e83fcd5a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:15:29 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:DELETE=8,cinder:SELECT=72,cinder:INSERT=26,cinder:UPDATE=92 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:15:29 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2864b8e-fb2c-4009-92fd-f37c12b30ddd tempest-VolumesMetadataTest-898939916 None] Acquiring lock "cinder-quobyte-061cac20-7032-4709-8c8d-e8c3e83fcd5a" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:15:29 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2864b8e-fb2c-4009-92fd-f37c12b30ddd tempest-VolumesMetadataTest-898939916 None] Lock "cinder-quobyte-061cac20-7032-4709-8c8d-e8c3e83fcd5a" acquired by "delete_volume" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:15:29 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcbad25-908a-4dfc-a432-a15f6ddcd0d6]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:15:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2864b8e-fb2c-4009-92fd-f37c12b30ddd tempest-VolumesMetadataTest-898939916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-061cac20-7032-4709-8c8d-e8c3e83fcd5a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:29 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-061cac20-7032-4709-8c8d-e8c3e83fcd5a Apr 27 10:15:29 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:29 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2864b8e-fb2c-4009-92fd-f37c12b30ddd tempest-VolumesMetadataTest-898939916 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-061cac20-7032-4709-8c8d-e8c3e83fcd5a" returned: 0 in 0.510s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2864b8e-fb2c-4009-92fd-f37c12b30ddd tempest-VolumesMetadataTest-898939916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-061cac20-7032-4709-8c8d-e8c3e83fcd5a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:29 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-061cac20-7032-4709-8c8d-e8c3e83fcd5a Apr 27 10:15:29 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:30 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2864b8e-fb2c-4009-92fd-f37c12b30ddd tempest-VolumesMetadataTest-898939916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-061cac20-7032-4709-8c8d-e8c3e83fcd5a" returned: 0 in 0.429s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2864b8e-fb2c-4009-92fd-f37c12b30ddd tempest-VolumesMetadataTest-898939916 None] Lock "cinder-quobyte-061cac20-7032-4709-8c8d-e8c3e83fcd5a" released by "delete_volume" :: held 0.979s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:15:30 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-d2864b8e-fb2c-4009-92fd-f37c12b30ddd tempest-VolumesMetadataTest-898939916 None] Created reservations ['56b4fd87-1e7c-4569-ae2b-1da060f8337b', '21dd8749-ccef-44dc-afcf-d7a46eec8057', '37a20bc8-d47b-4ef2-9a52-7656b101e4a1', '5aa90d80-a7c2-4e44-86ac-47bb712668cf'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:15:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d2864b8e-fb2c-4009-92fd-f37c12b30ddd tempest-VolumesMetadataTest-898939916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d2864b8e-fb2c-4009-92fd-f37c12b30ddd tempest-VolumesMetadataTest-898939916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:30 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d2864b8e-fb2c-4009-92fd-f37c12b30ddd tempest-VolumesMetadataTest-898939916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:15:30 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-d2864b8e-fb2c-4009-92fd-f37c12b30ddd tempest-VolumesMetadataTest-898939916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:15:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-d2864b8e-fb2c-4009-92fd-f37c12b30ddd tempest-VolumesMetadataTest-898939916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2864b8e-fb2c-4009-92fd-f37c12b30ddd tempest-VolumesMetadataTest-898939916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:30 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:15:30 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:30 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-d2864b8e-fb2c-4009-92fd-f37c12b30ddd tempest-VolumesMetadataTest-898939916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.429s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:30 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-d2864b8e-fb2c-4009-92fd-f37c12b30ddd tempest-VolumesMetadataTest-898939916 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:15:30 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-d2864b8e-fb2c-4009-92fd-f37c12b30ddd tempest-VolumesMetadataTest-898939916 None] Deleted volume successfully. Apr 27 10:15:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-d2864b8e-fb2c-4009-92fd-f37c12b30ddd tempest-VolumesMetadataTest-898939916 None] Lock "cinder-061cac20-7032-4709-8c8d-e8c3e83fcd5a-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:15:35 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:15:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Flow 'volume_create_manager' (bb6c9516-8fd2-47fd-9dc4-f177919ae786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:15:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1260d8a4-2936-4aaf-b0af-c91cace5a232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1260d8a4-2936-4aaf-b0af-c91cace5a232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1909233181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf26ae1-3a68-406c-a6a7-165e95717227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a981bcddc604d358f506eb997bc25d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:15:35Z,use_quota=True,user_id='8b71c6ab776a4007bbe0ee321160af91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5fb134-bb7f-4aa8-9147-51e12f56a35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5fb134-bb7f-4aa8-9147-51e12f56a35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb91d80-8f91-4b3b-b9f2-e6dfc82c38c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb91d80-8f91-4b3b-b9f2-e6dfc82c38c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebf26ae1-3a68-406c-a6a7-165e95717227', 'volume_name': 'volume-ebf26ae1-3a68-406c-a6a7-165e95717227', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae2d584-0c3d-4d8a-a415-30f0eead2937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae2d584-0c3d-4d8a-a415-30f0eead2937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3995f30-287c-4fbc-a902-c1ee2ccee787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:35 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Volume ebf26ae1-3a68-406c-a6a7-165e95717227: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebf26ae1-3a68-406c-a6a7-165e95717227', 'volume_size': 1} Apr 27 10:15:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1909233181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf26ae1-3a68-406c-a6a7-165e95717227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a981bcddc604d358f506eb997bc25d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:15:35Z,use_quota=True,user_id='8b71c6ab776a4007bbe0ee321160af91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:15:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Creating volume ebf26ae1-3a68-406c-a6a7-165e95717227 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:15:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:15:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:15:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:15:35 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:15:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ebf26ae1-3a68-406c-a6a7-165e95717227 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:35 devstack sudo[89639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ebf26ae1-3a68-406c-a6a7-165e95717227 1073741824 Apr 27 10:15:35 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:35 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ebf26ae1-3a68-406c-a6a7-165e95717227 1073741824" returned: 0 in 0.610s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ebf26ae1-3a68-406c-a6a7-165e95717227 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:35 devstack sudo[89644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ebf26ae1-3a68-406c-a6a7-165e95717227 Apr 27 10:15:35 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:36 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ebf26ae1-3a68-406c-a6a7-165e95717227" returned: 0 in 0.431s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:15:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3995f30-287c-4fbc-a902-c1ee2ccee787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebf26ae1-3a68-406c-a6a7-165e95717227', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad325d4-679f-4a63-8b3b-48a7ea4fdec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:36 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Volume volume-ebf26ae1-3a68-406c-a6a7-165e95717227 (ebf26ae1-3a68-406c-a6a7-165e95717227): created successfully Apr 27 10:15:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad325d4-679f-4a63-8b3b-48a7ea4fdec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Flow 'volume_create_manager' (bb6c9516-8fd2-47fd-9dc4-f177919ae786) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:15:36 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-0c8733b2-8d32-4588-b2d5-8e9ac2cd216e tempest-VolumesTransfersTest-1368726038 None] Created volume successfully. Apr 27 10:15:37 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-de109736-b0d5-47f0-a017-58de84603a2c tempest-VolumesTransfersTest-1671534333 None] Transfer volume completed successfully. Apr 27 10:15:38 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-27ce1352-aece-4489-8be4-12b6b7842301 tempest-VolumesTransfersTest-395082572 None] Acquiring lock "cinder-ebf26ae1-3a68-406c-a6a7-165e95717227-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:15:38 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-27ce1352-aece-4489-8be4-12b6b7842301 tempest-VolumesTransfersTest-395082572 None] Lock "cinder-ebf26ae1-3a68-406c-a6a7-165e95717227-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:15:38 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:INSERT=24,cinder:UPDATE=108,cinder:SELECT=75,cinder:DELETE=8 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:15:38 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-27ce1352-aece-4489-8be4-12b6b7842301 tempest-VolumesTransfersTest-395082572 None] Acquiring lock "cinder-quobyte-ebf26ae1-3a68-406c-a6a7-165e95717227" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:15:38 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-27ce1352-aece-4489-8be4-12b6b7842301 tempest-VolumesTransfersTest-395082572 None] Lock "cinder-quobyte-ebf26ae1-3a68-406c-a6a7-165e95717227" acquired by "delete_volume" :: waited 0.019s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:15:38 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a300b909-0c2a-46e2-802a-16011642cb2e]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:15:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-27ce1352-aece-4489-8be4-12b6b7842301 tempest-VolumesTransfersTest-395082572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ebf26ae1-3a68-406c-a6a7-165e95717227 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:38 devstack sudo[89647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ebf26ae1-3a68-406c-a6a7-165e95717227 Apr 27 10:15:38 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:39 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-27ce1352-aece-4489-8be4-12b6b7842301 tempest-VolumesTransfersTest-395082572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ebf26ae1-3a68-406c-a6a7-165e95717227" returned: 0 in 0.535s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-27ce1352-aece-4489-8be4-12b6b7842301 tempest-VolumesTransfersTest-395082572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ebf26ae1-3a68-406c-a6a7-165e95717227 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:39 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ebf26ae1-3a68-406c-a6a7-165e95717227 Apr 27 10:15:39 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:39 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-27ce1352-aece-4489-8be4-12b6b7842301 tempest-VolumesTransfersTest-395082572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-ebf26ae1-3a68-406c-a6a7-165e95717227" returned: 0 in 0.443s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-27ce1352-aece-4489-8be4-12b6b7842301 tempest-VolumesTransfersTest-395082572 None] Lock "cinder-quobyte-ebf26ae1-3a68-406c-a6a7-165e95717227" released by "delete_volume" :: held 1.017s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:15:39 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-27ce1352-aece-4489-8be4-12b6b7842301 tempest-VolumesTransfersTest-395082572 None] Created reservations ['8e0e4cad-dd7c-4381-ba72-06fe7ee42867', '4766f583-f949-4d5a-9592-defcd4159b21', 'a005003f-7a45-42a3-802d-fdf20bc3ea30', '479b2a73-8f20-45b4-953b-5aecf511b325'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:15:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-27ce1352-aece-4489-8be4-12b6b7842301 tempest-VolumesTransfersTest-395082572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-27ce1352-aece-4489-8be4-12b6b7842301 tempest-VolumesTransfersTest-395082572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:39 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-27ce1352-aece-4489-8be4-12b6b7842301 tempest-VolumesTransfersTest-395082572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:15:39 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-27ce1352-aece-4489-8be4-12b6b7842301 tempest-VolumesTransfersTest-395082572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:15:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-27ce1352-aece-4489-8be4-12b6b7842301 tempest-VolumesTransfersTest-395082572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-27ce1352-aece-4489-8be4-12b6b7842301 tempest-VolumesTransfersTest-395082572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:39 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:15:39 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:40 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-27ce1352-aece-4489-8be4-12b6b7842301 tempest-VolumesTransfersTest-395082572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.429s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:40 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-27ce1352-aece-4489-8be4-12b6b7842301 tempest-VolumesTransfersTest-395082572 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:15:40 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-27ce1352-aece-4489-8be4-12b6b7842301 tempest-VolumesTransfersTest-395082572 None] Deleted volume successfully. Apr 27 10:15:40 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-27ce1352-aece-4489-8be4-12b6b7842301 tempest-VolumesTransfersTest-395082572 None] Lock "cinder-ebf26ae1-3a68-406c-a6a7-165e95717227-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:15:41 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:15:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Flow 'volume_create_manager' (e9f22dff-2665-4412-8bc6-f4478e756f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:15:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a861e5f-d340-4cd3-a6cc-932921ce41ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a861e5f-d340-4cd3-a6cc-932921ce41ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2489133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5dc2e8-673d-4256-90b7-9ab2b7a52086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a981bcddc604d358f506eb997bc25d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:15:41Z,use_quota=True,user_id='8b71c6ab776a4007bbe0ee321160af91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24dc0588-8664-4d67-858c-b19e61af8951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24dc0588-8664-4d67-858c-b19e61af8951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c3a71d2-9f83-4e45-bbfe-41d7d0a06fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c3a71d2-9f83-4e45-bbfe-41d7d0a06fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a5dc2e8-673d-4256-90b7-9ab2b7a52086', 'volume_name': 'volume-7a5dc2e8-673d-4256-90b7-9ab2b7a52086', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac8c2a97-a72c-4151-ab4a-f25bbc276968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac8c2a97-a72c-4151-ab4a-f25bbc276968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49069eb7-c907-4445-be81-382bc53803cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:41 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Volume 7a5dc2e8-673d-4256-90b7-9ab2b7a52086: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a5dc2e8-673d-4256-90b7-9ab2b7a52086', 'volume_size': 1} Apr 27 10:15:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2489133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5dc2e8-673d-4256-90b7-9ab2b7a52086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a981bcddc604d358f506eb997bc25d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:15:41Z,use_quota=True,user_id='8b71c6ab776a4007bbe0ee321160af91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:15:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Creating volume 7a5dc2e8-673d-4256-90b7-9ab2b7a52086 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:15:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:15:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:15:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:15:41 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:15:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a5dc2e8-673d-4256-90b7-9ab2b7a52086 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:41 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a5dc2e8-673d-4256-90b7-9ab2b7a52086 1073741824 Apr 27 10:15:41 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:41 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a5dc2e8-673d-4256-90b7-9ab2b7a52086 1073741824" returned: 0 in 0.598s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a5dc2e8-673d-4256-90b7-9ab2b7a52086 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:41 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a5dc2e8-673d-4256-90b7-9ab2b7a52086 Apr 27 10:15:41 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:42 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a5dc2e8-673d-4256-90b7-9ab2b7a52086" returned: 0 in 0.451s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:42 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:15:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:42 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49069eb7-c907-4445-be81-382bc53803cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a5dc2e8-673d-4256-90b7-9ab2b7a52086', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:42 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4095e52a-277f-4441-84f9-c7635c95efe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:42 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Volume volume-7a5dc2e8-673d-4256-90b7-9ab2b7a52086 (7a5dc2e8-673d-4256-90b7-9ab2b7a52086): created successfully Apr 27 10:15:42 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4095e52a-277f-4441-84f9-c7635c95efe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:42 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Flow 'volume_create_manager' (e9f22dff-2665-4412-8bc6-f4478e756f04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:15:42 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-541875ab-7b17-44d6-9c69-685e2f6331b4 tempest-VolumesTransfersTest-1368726038 None] Created volume successfully. Apr 27 10:15:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3b23397c-19b3-4fee-99c5-45b7996fbf2f tempest-VolumesTransfersTest-395082572 None] Acquiring lock "cinder-7a5dc2e8-673d-4256-90b7-9ab2b7a52086-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:15:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3b23397c-19b3-4fee-99c5-45b7996fbf2f tempest-VolumesTransfersTest-395082572 None] Lock "cinder-7a5dc2e8-673d-4256-90b7-9ab2b7a52086-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:15:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3b23397c-19b3-4fee-99c5-45b7996fbf2f tempest-VolumesTransfersTest-395082572 None] Acquiring lock "cinder-quobyte-7a5dc2e8-673d-4256-90b7-9ab2b7a52086" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:15:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3b23397c-19b3-4fee-99c5-45b7996fbf2f tempest-VolumesTransfersTest-395082572 None] Lock "cinder-quobyte-7a5dc2e8-673d-4256-90b7-9ab2b7a52086" acquired by "delete_volume" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:15:43 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3380c58a-973c-4321-8315-c95b8f85ddcd]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:15:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b23397c-19b3-4fee-99c5-45b7996fbf2f tempest-VolumesTransfersTest-395082572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a5dc2e8-673d-4256-90b7-9ab2b7a52086 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:43 devstack sudo[89666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a5dc2e8-673d-4256-90b7-9ab2b7a52086 Apr 27 10:15:43 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:44 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b23397c-19b3-4fee-99c5-45b7996fbf2f tempest-VolumesTransfersTest-395082572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a5dc2e8-673d-4256-90b7-9ab2b7a52086" returned: 0 in 0.514s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b23397c-19b3-4fee-99c5-45b7996fbf2f tempest-VolumesTransfersTest-395082572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a5dc2e8-673d-4256-90b7-9ab2b7a52086 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:44 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a5dc2e8-673d-4256-90b7-9ab2b7a52086 Apr 27 10:15:44 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:44 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b23397c-19b3-4fee-99c5-45b7996fbf2f tempest-VolumesTransfersTest-395082572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-7a5dc2e8-673d-4256-90b7-9ab2b7a52086" returned: 0 in 0.429s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:44 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3b23397c-19b3-4fee-99c5-45b7996fbf2f tempest-VolumesTransfersTest-395082572 None] Lock "cinder-quobyte-7a5dc2e8-673d-4256-90b7-9ab2b7a52086" released by "delete_volume" :: held 0.991s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:15:44 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-3b23397c-19b3-4fee-99c5-45b7996fbf2f tempest-VolumesTransfersTest-395082572 None] Created reservations ['4b7530e3-cf09-4282-a512-eb83d192d295', '4313382a-e8bc-4535-9675-55a7d87c05a6', 'ff60c9d9-a9c6-4b03-a963-1dcf53a85e53', '1d36a8e8-312f-4449-bb68-0a37cd6862f4'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:15:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b23397c-19b3-4fee-99c5-45b7996fbf2f tempest-VolumesTransfersTest-395082572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b23397c-19b3-4fee-99c5-45b7996fbf2f tempest-VolumesTransfersTest-395082572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:44 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b23397c-19b3-4fee-99c5-45b7996fbf2f tempest-VolumesTransfersTest-395082572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:15:44 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b23397c-19b3-4fee-99c5-45b7996fbf2f tempest-VolumesTransfersTest-395082572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:15:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b23397c-19b3-4fee-99c5-45b7996fbf2f tempest-VolumesTransfersTest-395082572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b23397c-19b3-4fee-99c5-45b7996fbf2f tempest-VolumesTransfersTest-395082572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:44 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:15:44 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:45 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b23397c-19b3-4fee-99c5-45b7996fbf2f tempest-VolumesTransfersTest-395082572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.439s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:45 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-3b23397c-19b3-4fee-99c5-45b7996fbf2f tempest-VolumesTransfersTest-395082572 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:15:45 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-3b23397c-19b3-4fee-99c5-45b7996fbf2f tempest-VolumesTransfersTest-395082572 None] Deleted volume successfully. Apr 27 10:15:45 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3b23397c-19b3-4fee-99c5-45b7996fbf2f tempest-VolumesTransfersTest-395082572 None] Lock "cinder-7a5dc2e8-673d-4256-90b7-9ab2b7a52086-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:15:51 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:15:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Flow 'volume_create_manager' (28f18d3a-dd56-432d-ba2e-623fe5c93204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:15:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55276be-35d7-4310-b27d-77f3a3035673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55276be-35d7-4310-b27d-77f3a3035673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-97203525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e76b20817f84896afa380fb1be4a267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:15:51Z,use_quota=True,user_id='0e8ca23e72904846a03ce844275e173a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (121d361b-ac74-40dc-b9b4-003affffe4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (121d361b-ac74-40dc-b9b4-003affffe4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a618717-c55a-4e47-80b5-4884d59e37eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a618717-c55a-4e47-80b5-4884d59e37eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b', 'volume_name': 'volume-90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6081d46e-7ebd-430e-9424-dd04ea7f2b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6081d46e-7ebd-430e-9424-dd04ea7f2b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93898c7-7436-4a5f-a88e-67000c5dd8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:51 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Volume 90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b', 'volume_size': 1} Apr 27 10:15:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:51 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-97203525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e76b20817f84896afa380fb1be4a267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:15:51Z,use_quota=True,user_id='0e8ca23e72904846a03ce844275e173a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:15:51 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Creating volume 90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:15:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:51 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:15:51 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:15:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:51 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:15:51 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:15:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:51 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b 1073741824 Apr 27 10:15:51 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:52 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b 1073741824" returned: 0 in 0.628s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:52 devstack sudo[89683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b Apr 27 10:15:52 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:52 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b" returned: 0 in 0.452s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:52 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:15:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:52 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93898c7-7436-4a5f-a88e-67000c5dd8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:52 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ed6bc9-076a-4ca3-a291-d09c57dd895c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:52 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Volume volume-90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b (90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b): created successfully Apr 27 10:15:52 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ed6bc9-076a-4ca3-a291-d09c57dd895c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:52 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Flow 'volume_create_manager' (28f18d3a-dd56-432d-ba2e-623fe5c93204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:15:52 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-b37b47bd-a9e6-4910-90d8-99b46ea713c7 tempest-VolumesTransfersV357Test-741023517 None] Created volume successfully. Apr 27 10:15:54 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-5c63f506-c977-4293-a6c6-e9309654dfc7 tempest-VolumesTransfersV357Test-646025569 None] Transfer volume completed successfully. Apr 27 10:15:55 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ee2d6691-912d-4658-b1a0-05da73a13a16 tempest-VolumesTransfersV357Test-686755541 None] Acquiring lock "cinder-90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:15:55 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ee2d6691-912d-4658-b1a0-05da73a13a16 tempest-VolumesTransfersV357Test-686755541 None] Lock "cinder-90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:15:55 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ee2d6691-912d-4658-b1a0-05da73a13a16 tempest-VolumesTransfersV357Test-686755541 None] Acquiring lock "cinder-quobyte-90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:15:55 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ee2d6691-912d-4658-b1a0-05da73a13a16 tempest-VolumesTransfersV357Test-686755541 None] Lock "cinder-quobyte-90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b" acquired by "delete_volume" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:15:55 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[920d0f54-ed5d-4f60-90dc-7d2d33d90372]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:15:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ee2d6691-912d-4658-b1a0-05da73a13a16 tempest-VolumesTransfersV357Test-686755541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:55 devstack sudo[89687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b Apr 27 10:15:55 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:55 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ee2d6691-912d-4658-b1a0-05da73a13a16 tempest-VolumesTransfersV357Test-686755541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b" returned: 0 in 0.515s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ee2d6691-912d-4658-b1a0-05da73a13a16 tempest-VolumesTransfersV357Test-686755541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:55 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b Apr 27 10:15:55 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:56 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ee2d6691-912d-4658-b1a0-05da73a13a16 tempest-VolumesTransfersV357Test-686755541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b" returned: 0 in 0.431s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:56 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ee2d6691-912d-4658-b1a0-05da73a13a16 tempest-VolumesTransfersV357Test-686755541 None] Lock "cinder-quobyte-90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b" released by "delete_volume" :: held 0.985s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:15:56 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-ee2d6691-912d-4658-b1a0-05da73a13a16 tempest-VolumesTransfersV357Test-686755541 None] Created reservations ['72e2cc5b-c311-4cde-92d1-ea5a4079ba6d', '60472259-d522-4c09-a381-abdd689fce8c', '655319c8-b2bd-494b-8b03-b5195eed1b7a', '107c0c29-2065-4c23-b5fb-c27679836754'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:15:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ee2d6691-912d-4658-b1a0-05da73a13a16 tempest-VolumesTransfersV357Test-686755541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ee2d6691-912d-4658-b1a0-05da73a13a16 tempest-VolumesTransfersV357Test-686755541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ee2d6691-912d-4658-b1a0-05da73a13a16 tempest-VolumesTransfersV357Test-686755541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:15:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ee2d6691-912d-4658-b1a0-05da73a13a16 tempest-VolumesTransfersV357Test-686755541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:15:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ee2d6691-912d-4658-b1a0-05da73a13a16 tempest-VolumesTransfersV357Test-686755541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ee2d6691-912d-4658-b1a0-05da73a13a16 tempest-VolumesTransfersV357Test-686755541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:56 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:15:56 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:56 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ee2d6691-912d-4658-b1a0-05da73a13a16 tempest-VolumesTransfersV357Test-686755541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.431s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:56 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-ee2d6691-912d-4658-b1a0-05da73a13a16 tempest-VolumesTransfersV357Test-686755541 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:15:56 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-ee2d6691-912d-4658-b1a0-05da73a13a16 tempest-VolumesTransfersV357Test-686755541 None] Deleted volume successfully. Apr 27 10:15:56 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-ee2d6691-912d-4658-b1a0-05da73a13a16 tempest-VolumesTransfersV357Test-686755541 None] Lock "cinder-90bf3d2e-a05e-4ca6-a3d4-0d7e6f021b3b-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:15:57 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:15:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Flow 'volume_create_manager' (fc55ac55-d088-4aaa-b1a9-6153dded8207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:15:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9814d202-4322-43b0-9216-99f5f0565beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9814d202-4322-43b0-9216-99f5f0565beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1730180294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37257c2b-6aea-4064-8437-3767785696b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e76b20817f84896afa380fb1be4a267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:15:58Z,use_quota=True,user_id='0e8ca23e72904846a03ce844275e173a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b355d91-25d7-4b9d-a919-49a17b179459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b355d91-25d7-4b9d-a919-49a17b179459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b873090f-647e-4743-99ab-591ca7052501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b873090f-647e-4743-99ab-591ca7052501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37257c2b-6aea-4064-8437-3767785696b5', 'volume_name': 'volume-37257c2b-6aea-4064-8437-3767785696b5', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c47d274-6a19-48ce-91ca-5f0d1ed2271e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c47d274-6a19-48ce-91ca-5f0d1ed2271e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76245147-d501-41cf-a0bd-5648d2eb0d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:57 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Volume 37257c2b-6aea-4064-8437-3767785696b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37257c2b-6aea-4064-8437-3767785696b5', 'volume_size': 1} Apr 27 10:15:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1730180294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37257c2b-6aea-4064-8437-3767785696b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e76b20817f84896afa380fb1be4a267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:15:58Z,use_quota=True,user_id='0e8ca23e72904846a03ce844275e173a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:15:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Creating volume 37257c2b-6aea-4064-8437-3767785696b5 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:15:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:15:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:15:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:15:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:15:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:15:57 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:15:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-37257c2b-6aea-4064-8437-3767785696b5 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:57 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-37257c2b-6aea-4064-8437-3767785696b5 1073741824 Apr 27 10:15:57 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:58 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-37257c2b-6aea-4064-8437-3767785696b5 1073741824" returned: 0 in 0.599s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-37257c2b-6aea-4064-8437-3767785696b5 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:15:58 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-37257c2b-6aea-4064-8437-3767785696b5 Apr 27 10:15:58 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:15:58 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Apr 27 10:15:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-37257c2b-6aea-4064-8437-3767785696b5" returned: 0 in 0.438s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:15:58 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:15:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:15:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76245147-d501-41cf-a0bd-5648d2eb0d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37257c2b-6aea-4064-8437-3767785696b5', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68370e77-bed4-40da-a505-1f00d9fca69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:15:58 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Volume volume-37257c2b-6aea-4064-8437-3767785696b5 (37257c2b-6aea-4064-8437-3767785696b5): created successfully Apr 27 10:15:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68370e77-bed4-40da-a505-1f00d9fca69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:15:58 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Flow 'volume_create_manager' (fc55ac55-d088-4aaa-b1a9-6153dded8207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:15:58 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-2a1cccbc-993e-44aa-ae07-f23fe591ce21 tempest-VolumesTransfersV357Test-741023517 None] Created volume successfully. Apr 27 10:15:59 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-dda31c2a-4d24-44f7-98f7-cfaf658322c9 tempest-VolumesTransfersV357Test-686755541 None] Acquiring lock "cinder-37257c2b-6aea-4064-8437-3767785696b5-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:16:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-dda31c2a-4d24-44f7-98f7-cfaf658322c9 tempest-VolumesTransfersV357Test-686755541 None] Lock "cinder-37257c2b-6aea-4064-8437-3767785696b5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:16:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-dda31c2a-4d24-44f7-98f7-cfaf658322c9 tempest-VolumesTransfersV357Test-686755541 None] Acquiring lock "cinder-quobyte-37257c2b-6aea-4064-8437-3767785696b5" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:16:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-dda31c2a-4d24-44f7-98f7-cfaf658322c9 tempest-VolumesTransfersV357Test-686755541 None] Lock "cinder-quobyte-37257c2b-6aea-4064-8437-3767785696b5" acquired by "delete_volume" :: waited 0.017s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:16:00 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0de5f93-5175-45bc-9a5a-17c07e674951]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:16:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-dda31c2a-4d24-44f7-98f7-cfaf658322c9 tempest-VolumesTransfersV357Test-686755541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-37257c2b-6aea-4064-8437-3767785696b5 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:00 devstack sudo[89740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-37257c2b-6aea-4064-8437-3767785696b5 Apr 27 10:16:00 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:00 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-dda31c2a-4d24-44f7-98f7-cfaf658322c9 tempest-VolumesTransfersV357Test-686755541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-37257c2b-6aea-4064-8437-3767785696b5" returned: 0 in 0.518s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-dda31c2a-4d24-44f7-98f7-cfaf658322c9 tempest-VolumesTransfersV357Test-686755541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-37257c2b-6aea-4064-8437-3767785696b5 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:00 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-37257c2b-6aea-4064-8437-3767785696b5 Apr 27 10:16:00 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:01 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-dda31c2a-4d24-44f7-98f7-cfaf658322c9 tempest-VolumesTransfersV357Test-686755541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-37257c2b-6aea-4064-8437-3767785696b5" returned: 0 in 0.446s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:01 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-dda31c2a-4d24-44f7-98f7-cfaf658322c9 tempest-VolumesTransfersV357Test-686755541 None] Lock "cinder-quobyte-37257c2b-6aea-4064-8437-3767785696b5" released by "delete_volume" :: held 1.005s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:16:01 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-dda31c2a-4d24-44f7-98f7-cfaf658322c9 tempest-VolumesTransfersV357Test-686755541 None] Created reservations ['b1a42943-8095-448e-bde9-816c3e3ec3eb', 'b9d38633-35c8-428e-9375-36762bd45ef3', '6d6eca88-5a93-4330-b2e3-8ff36c2d8bf2', '1d3942b4-1971-4845-8ea6-2dac731794d0'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:16:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-dda31c2a-4d24-44f7-98f7-cfaf658322c9 tempest-VolumesTransfersV357Test-686755541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:16:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-dda31c2a-4d24-44f7-98f7-cfaf658322c9 tempest-VolumesTransfersV357Test-686755541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:16:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-dda31c2a-4d24-44f7-98f7-cfaf658322c9 tempest-VolumesTransfersV357Test-686755541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:16:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-dda31c2a-4d24-44f7-98f7-cfaf658322c9 tempest-VolumesTransfersV357Test-686755541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:16:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-dda31c2a-4d24-44f7-98f7-cfaf658322c9 tempest-VolumesTransfersV357Test-686755541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:16:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-dda31c2a-4d24-44f7-98f7-cfaf658322c9 tempest-VolumesTransfersV357Test-686755541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:01 devstack sudo[89748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:16:01 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:01 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-dda31c2a-4d24-44f7-98f7-cfaf658322c9 tempest-VolumesTransfersV357Test-686755541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.438s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:01 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-dda31c2a-4d24-44f7-98f7-cfaf658322c9 tempest-VolumesTransfersV357Test-686755541 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:16:01 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-dda31c2a-4d24-44f7-98f7-cfaf658322c9 tempest-VolumesTransfersV357Test-686755541 None] Deleted volume successfully. Apr 27 10:16:01 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-dda31c2a-4d24-44f7-98f7-cfaf658322c9 tempest-VolumesTransfersV357Test-686755541 None] Lock "cinder-37257c2b-6aea-4064-8437-3767785696b5-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:16:07 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:16:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Flow 'volume_create_manager' (507abbee-7f38-4ff0-b1d6-000bcd5e309a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:16:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527ded59-7037-44b4-a483-2dd6e67205e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527ded59-7037-44b4-a483-2dd6e67205e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1031204240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f330e0-4e33-49dd-80eb-46a4658b6a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162cc0d18ce74247bcd111ece2b78973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:16:07Z,use_quota=True,user_id='592881090b4447728831f2847406cabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e1b09ef-baf9-4c06-9228-32d7a6f39ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e1b09ef-baf9-4c06-9228-32d7a6f39ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef5f231-a5ef-481d-b1bb-0ee8805fb04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:07 devstack cinder-volume[81350]: DEBUG cinder.image.glance [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Creating Keystone auth plugin from conf {{(pid=81350) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 27 10:16:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef5f231-a5ef-481d-b1bb-0ee8805fb04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '82f330e0-4e33-49dd-80eb-46a4658b6a03', 'volume_name': 'volume-82f330e0-4e33-49dd-80eb-46a4658b6a03', 'volume_size': 1, 'image_id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f81a6757fcfa47c099a3bbded3b529cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'created_at': datetime.datetime(2026, 4, 27, 7, 59, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 7, 59, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0971daa7-86cc-4160-a37f-a4ba2790001e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0971daa7-86cc-4160-a37f-a4ba2790001e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:07 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586921a1-16e6-4c03-b609-5279dfb18a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:07 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Volume 82f330e0-4e33-49dd-80eb-46a4658b6a03: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-82f330e0-4e33-49dd-80eb-46a4658b6a03', 'volume_size': 1, 'image_id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f81a6757fcfa47c099a3bbded3b529cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'created_at': datetime.datetime(2026, 4, 27, 7, 59, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 7, 59, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 27 10:16:07 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Trying to clone 82f330e0-4e33-49dd-80eb-46a4658b6a03 from image d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa at location (None, [{'url': 'file:///opt/stack/data/glance/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'metadata': {}}]). {{(pid=81350) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 27 10:16:07 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_xpt4yvxcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81350) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 27 10:16:07 devstack cinder-volume[81350]: INFO cinder.image.image_utils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Image download 20.69 MB at 20.69 MB/s Apr 27 10:16:07 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecb86c0-9b3c-4b29-a0be-7c7fd4cb3cee]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:16:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_xpt4yvxcdevstack@QuobyteHD {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:07 devstack sudo[89753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_xpt4yvxcdevstack@QuobyteHD Apr 27 10:16:07 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:08 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_xpt4yvxcdevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:08 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Temporary image d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa is fetched for user 592881090b4447728831f2847406cabe. {{(pid=81350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 27 10:16:08 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abcf58c-baf8-4574-bdd7-43931f294f6b]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:16:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_xpt4yvxcdevstack@QuobyteHD {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:08 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_xpt4yvxcdevstack@QuobyteHD Apr 27 10:16:08 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:08 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_xpt4yvxcdevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:16:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:16:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1031204240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f330e0-4e33-49dd-80eb-46a4658b6a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162cc0d18ce74247bcd111ece2b78973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:16:07Z,use_quota=True,user_id='592881090b4447728831f2847406cabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:16:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Creating volume 82f330e0-4e33-49dd-80eb-46a4658b6a03 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:16:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:16:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:16:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:16:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:16:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:16:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:16:08 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:16:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:08 devstack sudo[89763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 1073741824 Apr 27 10:16:08 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:09 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 1073741824" returned: 0 in 0.648s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:09 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 Apr 27 10:16:09 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:09 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03" returned: 0 in 0.431s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:09 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:16:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:16:09 devstack cinder-volume[81350]: DEBUG cinder.volume.volume_utils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Attempting download of d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa ((None, [{'url': 'file:///opt/stack/data/glance/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'metadata': {}}])) to volume 82f330e0-4e33-49dd-80eb-46a4658b6a03. {{(pid=81350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 27 10:16:10 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb62bfe-6374-41b5-be52-d67e3dc744b6]: (4, 'raw') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:16:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_wyma7ke4 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:10 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_wyma7ke4 Apr 27 10:16:10 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:10 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_wyma7ke4" returned: 0 in 0.481s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_wyma7ke4 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:10 devstack sudo[89775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_wyma7ke4 Apr 27 10:16:10 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:10 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_wyma7ke4" returned: 1 in 0.495s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_wyma7ke4' failed. Not Retrying. {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 10:16:10 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb520c6-458d-4b1e-b5ed-cdc1fab2612b]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:16:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_xpt4yvxcdevstack@QuobyteHD {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:11 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_xpt4yvxcdevstack@QuobyteHD Apr 27 10:16:11 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:11 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_xpt4yvxcdevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:11 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa was qcow2, converting to raw {{(pid=81350) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 27 10:16:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_xpt4yvxcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:11 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_xpt4yvxcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 Apr 27 10:16:11 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:12 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_xpt4yvxcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03" returned: 0 in 1.280s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:12 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa_xpt4yvxcdevstack@QuobyteHD, size 112.00 MB, duration 1.28 sec, destination /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 {{(pid=81350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 10:16:12 devstack cinder-volume[81350]: INFO cinder.image.image_utils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Converted 112.00 MB image at 87.38 MB/s Apr 27 10:16:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:12 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 1G Apr 27 10:16:12 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:13 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 1G" returned: 0 in 0.481s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:13 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cefb1a4-d2aa-48a2-92d1-46b3e06eba37]: (4, 'raw') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:16:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:13 devstack sudo[89796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 Apr 27 10:16:13 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:13 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03" returned: 0 in 0.539s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:13 devstack sudo[89800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 Apr 27 10:16:13 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:14 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03" returned: 1 in 0.527s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03' failed. Not Retrying. {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 10:16:14 devstack cinder-volume[81350]: DEBUG cinder.volume.volume_utils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Downloaded image d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa ((None, [{'url': 'file:///opt/stack/data/glance/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'metadata': {}}])) to volume 82f330e0-4e33-49dd-80eb-46a4658b6a03 successfully. {{(pid=81350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 27 10:16:14 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Temporary image d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa for user 592881090b4447728831f2847406cabe is deleted. {{(pid=81350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 27 10:16:14 devstack cinder-volume[81350]: DEBUG cinder.volume.volume_utils [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Marking volume 82f330e0-4e33-49dd-80eb-46a4658b6a03 as bootable. {{(pid=81350) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 27 10:16:14 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Copying metadata from image d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa to 82f330e0-4e33-49dd-80eb-46a4658b6a03. {{(pid=81350) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 27 10:16:14 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Creating volume glance metadata for volume 82f330e0-4e33-49dd-80eb-46a4658b6a03 backed by image d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81350) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 27 10:16:14 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586921a1-16e6-4c03-b609-5279dfb18a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82f330e0-4e33-49dd-80eb-46a4658b6a03', 'volume_size': 1, 'image_id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f81a6757fcfa47c099a3bbded3b529cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd65dcfd3-8f6c-4b97-95a6-0719b1c67cfa', 'created_at': datetime.datetime(2026, 4, 27, 7, 59, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 7, 59, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d65dcfd3-8f6c-4b97-95a6-0719b1c67cfa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:14 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c561b146-a4f0-47c5-ab83-8f70e643a92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:14 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Volume volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 (82f330e0-4e33-49dd-80eb-46a4658b6a03): created successfully Apr 27 10:16:14 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c561b146-a4f0-47c5-ab83-8f70e643a92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:14 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Flow 'volume_create_manager' (507abbee-7f38-4ff0-b1d6-000bcd5e309a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:16:14 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-3e166f9d-f7e7-4177-84b6-69aa807a427d tempest-VolumesExtendTest-391643563 None] Created volume successfully. Apr 27 10:16:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-17726e3c-15d7-4f65-85f2-f535db170ff8 tempest-VolumesExtendTest-391643563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:16:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-17726e3c-15d7-4f65-85f2-f535db170ff8 tempest-VolumesExtendTest-391643563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:16:15 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a75c8f3-ae96-4710-847a-33ce20be0c9c]: (4, 'raw') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:16:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-17726e3c-15d7-4f65-85f2-f535db170ff8 tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:15 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 Apr 27 10:16:15 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:16 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-17726e3c-15d7-4f65-85f2-f535db170ff8 tempest-VolumesExtendTest-391643563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03" returned: 0 in 0.527s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-17726e3c-15d7-4f65-85f2-f535db170ff8 tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:16 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 Apr 27 10:16:16 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:16 devstack cinder-volume[81350]: DEBUG oslo_service.periodic_task [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81350) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 10:16:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:16:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:16:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:16:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:16:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:16:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:16 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:16:16 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:16 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-17726e3c-15d7-4f65-85f2-f535db170ff8 tempest-VolumesExtendTest-391643563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03" returned: 1 in 0.518s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-17726e3c-15d7-4f65-85f2-f535db170ff8 tempest-VolumesExtendTest-391643563 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03' failed. Not Retrying. {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 10:16:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-17726e3c-15d7-4f65-85f2-f535db170ff8 tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 2G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-17726e3c-15d7-4f65-85f2-f535db170ff8 tempest-VolumesExtendTest-391643563 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 2G" returned: 0 in 0.070s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-17726e3c-15d7-4f65-85f2-f535db170ff8 tempest-VolumesExtendTest-391643563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.156s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:16:16 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-17726e3c-15d7-4f65-85f2-f535db170ff8 tempest-VolumesExtendTest-391643563 None] Extend volume completed successfully. Apr 27 10:16:17 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.465s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:17 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:16:18 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-0e3870c6-242d-4bb2-b0eb-c6ea683c0d50 tempest-VolumesExtendTest-391643563 None] Acquiring lock "cinder-82f330e0-4e33-49dd-80eb-46a4658b6a03-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:16:18 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-0e3870c6-242d-4bb2-b0eb-c6ea683c0d50 tempest-VolumesExtendTest-391643563 None] Lock "cinder-82f330e0-4e33-49dd-80eb-46a4658b6a03-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:16:18 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-0e3870c6-242d-4bb2-b0eb-c6ea683c0d50 tempest-VolumesExtendTest-391643563 None] Acquiring lock "cinder-quobyte-82f330e0-4e33-49dd-80eb-46a4658b6a03" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:16:18 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-0e3870c6-242d-4bb2-b0eb-c6ea683c0d50 tempest-VolumesExtendTest-391643563 None] Lock "cinder-quobyte-82f330e0-4e33-49dd-80eb-46a4658b6a03" acquired by "delete_volume" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:16:18 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[340951ab-8c3b-4418-a92c-05071974d177]: (4, 'raw') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:16:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0e3870c6-242d-4bb2-b0eb-c6ea683c0d50 tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:18 devstack sudo[89829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 Apr 27 10:16:18 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:18 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0e3870c6-242d-4bb2-b0eb-c6ea683c0d50 tempest-VolumesExtendTest-391643563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03" returned: 0 in 0.504s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0e3870c6-242d-4bb2-b0eb-c6ea683c0d50 tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:18 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 Apr 27 10:16:18 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:19 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0e3870c6-242d-4bb2-b0eb-c6ea683c0d50 tempest-VolumesExtendTest-391643563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03" returned: 1 in 0.504s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0e3870c6-242d-4bb2-b0eb-c6ea683c0d50 tempest-VolumesExtendTest-391643563 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03' failed. Not Retrying. {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 10:16:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0e3870c6-242d-4bb2-b0eb-c6ea683c0d50 tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:19 devstack sudo[89838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03 Apr 27 10:16:19 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:19 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0e3870c6-242d-4bb2-b0eb-c6ea683c0d50 tempest-VolumesExtendTest-391643563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-82f330e0-4e33-49dd-80eb-46a4658b6a03" returned: 0 in 0.443s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:19 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-0e3870c6-242d-4bb2-b0eb-c6ea683c0d50 tempest-VolumesExtendTest-391643563 None] Lock "cinder-quobyte-82f330e0-4e33-49dd-80eb-46a4658b6a03" released by "delete_volume" :: held 1.511s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:16:19 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-0e3870c6-242d-4bb2-b0eb-c6ea683c0d50 tempest-VolumesExtendTest-391643563 None] Created reservations ['ab2b1392-cf56-4ef6-829f-7db839e22f28', '1435881d-cbfb-48e7-86ac-f5023c1839dc', 'aecea0df-e4d7-4604-a732-592ea0e51f66', '199a5451-654e-439d-b755-66a93e101da2'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:16:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0e3870c6-242d-4bb2-b0eb-c6ea683c0d50 tempest-VolumesExtendTest-391643563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:16:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0e3870c6-242d-4bb2-b0eb-c6ea683c0d50 tempest-VolumesExtendTest-391643563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:16:19 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0e3870c6-242d-4bb2-b0eb-c6ea683c0d50 tempest-VolumesExtendTest-391643563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:16:19 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0e3870c6-242d-4bb2-b0eb-c6ea683c0d50 tempest-VolumesExtendTest-391643563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:16:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0e3870c6-242d-4bb2-b0eb-c6ea683c0d50 tempest-VolumesExtendTest-391643563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:16:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0e3870c6-242d-4bb2-b0eb-c6ea683c0d50 tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:19 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:16:19 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:20 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0e3870c6-242d-4bb2-b0eb-c6ea683c0d50 tempest-VolumesExtendTest-391643563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.424s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-0e3870c6-242d-4bb2-b0eb-c6ea683c0d50 tempest-VolumesExtendTest-391643563 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:16:20 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-0e3870c6-242d-4bb2-b0eb-c6ea683c0d50 tempest-VolumesExtendTest-391643563 None] Deleted volume successfully. Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-0e3870c6-242d-4bb2-b0eb-c6ea683c0d50 tempest-VolumesExtendTest-391643563 None] Lock "cinder-82f330e0-4e33-49dd-80eb-46a4658b6a03-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Flow 'volume_create_manager' (1e4b47e8-bb0c-4e2e-b173-ece39c2bb7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f10c5a2-069b-4f68-b433-d9fb3bc2c9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f10c5a2-069b-4f68-b433-d9fb3bc2c9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1182643632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94e03e5e-e1c1-408c-8977-797c49b5137c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162cc0d18ce74247bcd111ece2b78973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:16:21Z,use_quota=True,user_id='592881090b4447728831f2847406cabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2938e153-a48b-48c8-842f-47c8341cbeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2938e153-a48b-48c8-842f-47c8341cbeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d83655-1a9f-4787-ac50-c4227b0ecb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d83655-1a9f-4787-ac50-c4227b0ecb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94e03e5e-e1c1-408c-8977-797c49b5137c', 'volume_name': 'volume-94e03e5e-e1c1-408c-8977-797c49b5137c', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022083ef-6569-4885-a1bc-ec1ea53bf380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022083ef-6569-4885-a1bc-ec1ea53bf380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c38416d-adea-4139-971d-aae17116a841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:20 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Volume 94e03e5e-e1c1-408c-8977-797c49b5137c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94e03e5e-e1c1-408c-8977-797c49b5137c', 'volume_size': 1} Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1182643632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94e03e5e-e1c1-408c-8977-797c49b5137c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162cc0d18ce74247bcd111ece2b78973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:16:21Z,use_quota=True,user_id='592881090b4447728831f2847406cabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Creating volume 94e03e5e-e1c1-408c-8977-797c49b5137c {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:16:20 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:16:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:20 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c 1073741824 Apr 27 10:16:20 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:21 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c 1073741824" returned: 0 in 0.580s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:21 devstack sudo[89849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c Apr 27 10:16:21 devstack sudo[89849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:21 devstack sudo[89849]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c" returned: 0 in 0.445s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:21 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:16:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:16:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c38416d-adea-4139-971d-aae17116a841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94e03e5e-e1c1-408c-8977-797c49b5137c', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63b642d-bfd0-4910-b561-982d18dbbde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:21 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Volume volume-94e03e5e-e1c1-408c-8977-797c49b5137c (94e03e5e-e1c1-408c-8977-797c49b5137c): created successfully Apr 27 10:16:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63b642d-bfd0-4910-b561-982d18dbbde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Flow 'volume_create_manager' (1e4b47e8-bb0c-4e2e-b173-ece39c2bb7be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:16:21 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-57ea22d5-57d5-495e-ab2e-caa0e3b83ddf tempest-VolumesExtendTest-391643563 None] Created volume successfully. Apr 27 10:16:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-6ed03aff-6385-4bce-bb11-c590bc750ece tempest-VolumesExtendTest-391643563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:16:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-6ed03aff-6385-4bce-bb11-c590bc750ece tempest-VolumesExtendTest-391643563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:16:22 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-6ed03aff-6385-4bce-bb11-c590bc750ece tempest-VolumesExtendTest-391643563 None] Creating offline snapshot 8f9574f7-c267-41c5-9475-379e80c2570a of volume 94e03e5e-e1c1-408c-8977-797c49b5137c {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:16:22 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5093995-1bd5-4777-919b-3a44d0da5bc6]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:16:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6ed03aff-6385-4bce-bb11-c590bc750ece tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:22 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c Apr 27 10:16:22 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:23 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6ed03aff-6385-4bce-bb11-c590bc750ece tempest-VolumesExtendTest-391643563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c" returned: 0 in 0.511s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6ed03aff-6385-4bce-bb11-c590bc750ece tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.8f9574f7-c267-41c5-9475-379e80c2570a 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:23 devstack sudo[89857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.8f9574f7-c267-41c5-9475-379e80c2570a 1G Apr 27 10:16:23 devstack sudo[89857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:23 devstack sudo[89857]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6ed03aff-6385-4bce-bb11-c590bc750ece tempest-VolumesExtendTest-391643563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.8f9574f7-c267-41c5-9475-379e80c2570a 1G" returned: 0 in 0.575s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6ed03aff-6385-4bce-bb11-c590bc750ece tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e03e5e-e1c1-408c-8977-797c49b5137c -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.8f9574f7-c267-41c5-9475-379e80c2570a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:23 devstack sudo[89862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e03e5e-e1c1-408c-8977-797c49b5137c -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.8f9574f7-c267-41c5-9475-379e80c2570a Apr 27 10:16:23 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:24 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6ed03aff-6385-4bce-bb11-c590bc750ece tempest-VolumesExtendTest-391643563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e03e5e-e1c1-408c-8977-797c49b5137c -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.8f9574f7-c267-41c5-9475-379e80c2570a" returned: 0 in 0.473s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:24 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-6ed03aff-6385-4bce-bb11-c590bc750ece tempest-VolumesExtendTest-391643563 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.8f9574f7-c267-41c5-9475-379e80c2570a is being set with open permissions: ugo+rw Apr 27 10:16:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6ed03aff-6385-4bce-bb11-c590bc750ece tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.8f9574f7-c267-41c5-9475-379e80c2570a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:24 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.8f9574f7-c267-41c5-9475-379e80c2570a Apr 27 10:16:24 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:24 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6ed03aff-6385-4bce-bb11-c590bc750ece tempest-VolumesExtendTest-391643563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.8f9574f7-c267-41c5-9475-379e80c2570a" returned: 0 in 0.431s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6ed03aff-6385-4bce-bb11-c590bc750ece tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:24 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.info Apr 27 10:16:24 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:25 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6ed03aff-6385-4bce-bb11-c590bc750ece tempest-VolumesExtendTest-391643563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.info" returned: 0 in 0.436s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:25 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-6ed03aff-6385-4bce-bb11-c590bc750ece tempest-VolumesExtendTest-391643563 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.info is being set with open permissions: ugo+rw Apr 27 10:16:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6ed03aff-6385-4bce-bb11-c590bc750ece tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:25 devstack sudo[89874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.info Apr 27 10:16:25 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:25 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6ed03aff-6385-4bce-bb11-c590bc750ece tempest-VolumesExtendTest-391643563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.info" returned: 0 in 0.415s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-6ed03aff-6385-4bce-bb11-c590bc750ece tempest-VolumesExtendTest-391643563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.926s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:16:25 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-6ed03aff-6385-4bce-bb11-c590bc750ece tempest-VolumesExtendTest-391643563 None] Create snapshot completed successfully Apr 27 10:16:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-fc6f3cb6-c045-4d7f-b40e-dd9ea74df1a2 tempest-VolumesExtendTest-391643563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:16:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-fc6f3cb6-c045-4d7f-b40e-dd9ea74df1a2 tempest-VolumesExtendTest-391643563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:16:26 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1945bf-2b86-43f7-9487-b5385bd51d9c]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:16:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fc6f3cb6-c045-4d7f-b40e-dd9ea74df1a2 tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:26 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c Apr 27 10:16:26 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:26 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fc6f3cb6-c045-4d7f-b40e-dd9ea74df1a2 tempest-VolumesExtendTest-391643563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c" returned: 0 in 0.509s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fc6f3cb6-c045-4d7f-b40e-dd9ea74df1a2 tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.8f9574f7-c267-41c5-9475-379e80c2570a 2G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fc6f3cb6-c045-4d7f-b40e-dd9ea74df1a2 tempest-VolumesExtendTest-391643563 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.8f9574f7-c267-41c5-9475-379e80c2570a 2G" returned: 0 in 0.121s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-fc6f3cb6-c045-4d7f-b40e-dd9ea74df1a2 tempest-VolumesExtendTest-391643563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.661s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:16:26 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-fc6f3cb6-c045-4d7f-b40e-dd9ea74df1a2 tempest-VolumesExtendTest-391643563 None] Extend volume completed successfully. Apr 27 10:16:27 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5d4876f6-e6cd-4345-b95e-4cf0595b8210 tempest-VolumesExtendTest-391643563 None] Acquiring lock "cinder-8f9574f7-c267-41c5-9475-379e80c2570a-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:16:27 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5d4876f6-e6cd-4345-b95e-4cf0595b8210 tempest-VolumesExtendTest-391643563 None] Lock "cinder-8f9574f7-c267-41c5-9475-379e80c2570a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:16:27 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5d4876f6-e6cd-4345-b95e-4cf0595b8210 tempest-VolumesExtendTest-391643563 None] Acquiring lock "cinder-quobyte-94e03e5e-e1c1-408c-8977-797c49b5137c" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:16:27 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5d4876f6-e6cd-4345-b95e-4cf0595b8210 tempest-VolumesExtendTest-391643563 None] Lock "cinder-quobyte-94e03e5e-e1c1-408c-8977-797c49b5137c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:16:27 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5d4876f6-e6cd-4345-b95e-4cf0595b8210 tempest-VolumesExtendTest-391643563 None] Acquiring lock "cinder-quobyte-8f9574f7-c267-41c5-9475-379e80c2570a" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:16:27 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5d4876f6-e6cd-4345-b95e-4cf0595b8210 tempest-VolumesExtendTest-391643563 None] Lock "cinder-quobyte-8f9574f7-c267-41c5-9475-379e80c2570a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:16:27 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-5d4876f6-e6cd-4345-b95e-4cf0595b8210 tempest-VolumesExtendTest-391643563 None] Deleting offline snapshot 8f9574f7-c267-41c5-9475-379e80c2570a of volume 94e03e5e-e1c1-408c-8977-797c49b5137c {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:16:27 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-5d4876f6-e6cd-4345-b95e-4cf0595b8210 tempest-VolumesExtendTest-391643563 None] snapshot_file for this snap is: volume-94e03e5e-e1c1-408c-8977-797c49b5137c.8f9574f7-c267-41c5-9475-379e80c2570a {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:16:27 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7a0c66-aa36-4d21-af5f-f8dac372e438]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:16:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5d4876f6-e6cd-4345-b95e-4cf0595b8210 tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.8f9574f7-c267-41c5-9475-379e80c2570a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:27 devstack sudo[89885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.8f9574f7-c267-41c5-9475-379e80c2570a Apr 27 10:16:27 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:27 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5d4876f6-e6cd-4345-b95e-4cf0595b8210 tempest-VolumesExtendTest-391643563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.8f9574f7-c267-41c5-9475-379e80c2570a" returned: 0 in 0.520s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:27 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-5d4876f6-e6cd-4345-b95e-4cf0595b8210 tempest-VolumesExtendTest-391643563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94e03e5e-e1c1-408c-8977-797c49b5137c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:16:27 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[776cdd0d-13f0-4aef-8761-d7da204b90a1]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:16:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5d4876f6-e6cd-4345-b95e-4cf0595b8210 tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:27 devstack sudo[89890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c Apr 27 10:16:27 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:28 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5d4876f6-e6cd-4345-b95e-4cf0595b8210 tempest-VolumesExtendTest-391643563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c" returned: 0 in 0.511s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5d4876f6-e6cd-4345-b95e-4cf0595b8210 tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.8f9574f7-c267-41c5-9475-379e80c2570a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:28 devstack sudo[89895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.8f9574f7-c267-41c5-9475-379e80c2570a Apr 27 10:16:28 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:28 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5d4876f6-e6cd-4345-b95e-4cf0595b8210 tempest-VolumesExtendTest-391643563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.8f9574f7-c267-41c5-9475-379e80c2570a" returned: 0 in 0.545s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5d4876f6-e6cd-4345-b95e-4cf0595b8210 tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.8f9574f7-c267-41c5-9475-379e80c2570a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:28 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.8f9574f7-c267-41c5-9475-379e80c2570a Apr 27 10:16:28 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:29 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5d4876f6-e6cd-4345-b95e-4cf0595b8210 tempest-VolumesExtendTest-391643563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c.8f9574f7-c267-41c5-9475-379e80c2570a" returned: 0 in 0.445s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:29 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:SELECT=51,cinder:INSERT=17,cinder:UPDATE=77,cinder:DELETE=7 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:16:29 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5d4876f6-e6cd-4345-b95e-4cf0595b8210 tempest-VolumesExtendTest-391643563 None] Lock "cinder-quobyte-8f9574f7-c267-41c5-9475-379e80c2570a" released by "_delete_snapshot" :: held 2.122s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:16:29 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5d4876f6-e6cd-4345-b95e-4cf0595b8210 tempest-VolumesExtendTest-391643563 None] Lock "cinder-quobyte-94e03e5e-e1c1-408c-8977-797c49b5137c" released by "delete_snapshot" :: held 2.147s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:16:29 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-5d4876f6-e6cd-4345-b95e-4cf0595b8210 tempest-VolumesExtendTest-391643563 None] Created reservations ['15bb7fc1-8f30-4790-910a-0c9f16e5baf0', '09ff5d21-3343-460b-865e-ce953d54491a', '903e8a61-2059-4d19-9807-c0d08ee23a98', 'e9968e44-9311-4651-a792-dbaba946c223'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:16:29 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-5d4876f6-e6cd-4345-b95e-4cf0595b8210 tempest-VolumesExtendTest-391643563 None] Delete snapshot completed successfully. Apr 27 10:16:29 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5d4876f6-e6cd-4345-b95e-4cf0595b8210 tempest-VolumesExtendTest-391643563 None] Lock "cinder-8f9574f7-c267-41c5-9475-379e80c2570a-delete_snapshot" released by "delete_snapshot" :: held 2.274s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:16:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-afa79863-040c-4398-909c-09a6a7bb77cc tempest-VolumesExtendTest-391643563 None] Acquiring lock "cinder-94e03e5e-e1c1-408c-8977-797c49b5137c-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:16:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-afa79863-040c-4398-909c-09a6a7bb77cc tempest-VolumesExtendTest-391643563 None] Lock "cinder-94e03e5e-e1c1-408c-8977-797c49b5137c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:16:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-afa79863-040c-4398-909c-09a6a7bb77cc tempest-VolumesExtendTest-391643563 None] Acquiring lock "cinder-quobyte-94e03e5e-e1c1-408c-8977-797c49b5137c" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:16:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-afa79863-040c-4398-909c-09a6a7bb77cc tempest-VolumesExtendTest-391643563 None] Lock "cinder-quobyte-94e03e5e-e1c1-408c-8977-797c49b5137c" acquired by "delete_volume" :: waited 0.014s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:16:30 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b5757a-f0bd-4f62-8508-8f7defad1ab0]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:16:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-afa79863-040c-4398-909c-09a6a7bb77cc tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:30 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c Apr 27 10:16:30 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:31 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-afa79863-040c-4398-909c-09a6a7bb77cc tempest-VolumesExtendTest-391643563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c" returned: 0 in 0.502s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-afa79863-040c-4398-909c-09a6a7bb77cc tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:31 devstack sudo[89910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c Apr 27 10:16:31 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:31 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-afa79863-040c-4398-909c-09a6a7bb77cc tempest-VolumesExtendTest-391643563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-94e03e5e-e1c1-408c-8977-797c49b5137c" returned: 0 in 0.425s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-afa79863-040c-4398-909c-09a6a7bb77cc tempest-VolumesExtendTest-391643563 None] Lock "cinder-quobyte-94e03e5e-e1c1-408c-8977-797c49b5137c" released by "delete_volume" :: held 0.985s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:16:31 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-afa79863-040c-4398-909c-09a6a7bb77cc tempest-VolumesExtendTest-391643563 None] Created reservations ['df770291-4f46-4a27-b16f-deae5ac67981', '2023cc10-7aa0-4e59-9941-47b1df4011e6', '01d0b00f-89a1-4991-8b70-d38c3ca27d5e', '1eb76709-a6a7-4e4e-b534-aa8ae352433b'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:16:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-afa79863-040c-4398-909c-09a6a7bb77cc tempest-VolumesExtendTest-391643563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:16:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-afa79863-040c-4398-909c-09a6a7bb77cc tempest-VolumesExtendTest-391643563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:16:31 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-afa79863-040c-4398-909c-09a6a7bb77cc tempest-VolumesExtendTest-391643563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:16:31 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-afa79863-040c-4398-909c-09a6a7bb77cc tempest-VolumesExtendTest-391643563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:16:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-afa79863-040c-4398-909c-09a6a7bb77cc tempest-VolumesExtendTest-391643563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:16:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-afa79863-040c-4398-909c-09a6a7bb77cc tempest-VolumesExtendTest-391643563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:31 devstack sudo[89913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:16:31 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:32 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-afa79863-040c-4398-909c-09a6a7bb77cc tempest-VolumesExtendTest-391643563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.427s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:32 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-afa79863-040c-4398-909c-09a6a7bb77cc tempest-VolumesExtendTest-391643563 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:16:32 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-afa79863-040c-4398-909c-09a6a7bb77cc tempest-VolumesExtendTest-391643563 None] Deleted volume successfully. Apr 27 10:16:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-afa79863-040c-4398-909c-09a6a7bb77cc tempest-VolumesExtendTest-391643563 None] Lock "cinder-94e03e5e-e1c1-408c-8977-797c49b5137c-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:16:35 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:16:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Flow 'volume_create_manager' (49c5ffa0-f6b0-430d-8bc8-96d2ffb96877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:16:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4f4b0d0-127b-4e09-955b-6c83d4e0ffc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4f4b0d0-127b-4e09-955b-6c83d4e0ffc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-890784102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b04a4aaf-edbc-4daa-9dab-2574fb045047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082a38b2a8a4ccf9f4ac1fa0cb2cc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:16:35Z,use_quota=True,user_id='de9efe45637c4dd2b85c635812f2cef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa1e8b4-f022-415a-803a-93bb1b0c211a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa1e8b4-f022-415a-803a-93bb1b0c211a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebafa872-d89f-4eaf-bbba-930497fc7cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebafa872-d89f-4eaf-bbba-930497fc7cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b04a4aaf-edbc-4daa-9dab-2574fb045047', 'volume_name': 'volume-b04a4aaf-edbc-4daa-9dab-2574fb045047', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a27e8c4-be54-4d05-8681-b9ae0aef1970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a27e8c4-be54-4d05-8681-b9ae0aef1970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ded324-28b3-4199-a90a-407bc18e7286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:35 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Volume b04a4aaf-edbc-4daa-9dab-2574fb045047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b04a4aaf-edbc-4daa-9dab-2574fb045047', 'volume_size': 1} Apr 27 10:16:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:16:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:16:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-890784102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b04a4aaf-edbc-4daa-9dab-2574fb045047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082a38b2a8a4ccf9f4ac1fa0cb2cc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:16:35Z,use_quota=True,user_id='de9efe45637c4dd2b85c635812f2cef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:16:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Creating volume b04a4aaf-edbc-4daa-9dab-2574fb045047 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:16:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:16:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:16:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:16:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:16:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:16:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:16:35 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:16:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:35 devstack sudo[89918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 1073741824 Apr 27 10:16:35 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:35 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 1073741824" returned: 0 in 0.590s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:35 devstack sudo[89923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 Apr 27 10:16:35 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:36 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047" returned: 0 in 0.460s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:16:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:16:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ded324-28b3-4199-a90a-407bc18e7286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b04a4aaf-edbc-4daa-9dab-2574fb045047', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (921dc547-7375-4f9d-bc9e-bc810920ef17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:36 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Volume volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 (b04a4aaf-edbc-4daa-9dab-2574fb045047): created successfully Apr 27 10:16:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (921dc547-7375-4f9d-bc9e-bc810920ef17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Flow 'volume_create_manager' (49c5ffa0-f6b0-430d-8bc8-96d2ffb96877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:16:36 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-b51cef52-50ff-406e-9756-f2cda8ccb209 tempest-VolumeDependencyTests-1725326561 None] Created volume successfully. Apr 27 10:16:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-cb0aac5b-db91-4c8c-9702-8ebd8c1a73aa tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:16:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-cb0aac5b-db91-4c8c-9702-8ebd8c1a73aa tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:16:37 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-cb0aac5b-db91-4c8c-9702-8ebd8c1a73aa tempest-VolumeDependencyTests-1725326561 None] Creating offline snapshot 83f6c6a6-ee58-4884-a343-2f0a32e6b4e6 of volume b04a4aaf-edbc-4daa-9dab-2574fb045047 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:16:37 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[aada1d24-8d8e-4815-9f09-4bd4570c7c87]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:16:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cb0aac5b-db91-4c8c-9702-8ebd8c1a73aa tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:37 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 Apr 27 10:16:37 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:37 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cb0aac5b-db91-4c8c-9702-8ebd8c1a73aa tempest-VolumeDependencyTests-1725326561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047" returned: 0 in 0.529s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cb0aac5b-db91-4c8c-9702-8ebd8c1a73aa tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.83f6c6a6-ee58-4884-a343-2f0a32e6b4e6 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:37 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.83f6c6a6-ee58-4884-a343-2f0a32e6b4e6 1G Apr 27 10:16:37 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:38 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cb0aac5b-db91-4c8c-9702-8ebd8c1a73aa tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.83f6c6a6-ee58-4884-a343-2f0a32e6b4e6 1G" returned: 0 in 0.580s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cb0aac5b-db91-4c8c-9702-8ebd8c1a73aa tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.83f6c6a6-ee58-4884-a343-2f0a32e6b4e6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:38 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.83f6c6a6-ee58-4884-a343-2f0a32e6b4e6 Apr 27 10:16:38 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:38 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cb0aac5b-db91-4c8c-9702-8ebd8c1a73aa tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.83f6c6a6-ee58-4884-a343-2f0a32e6b4e6" returned: 0 in 0.473s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:38 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-cb0aac5b-db91-4c8c-9702-8ebd8c1a73aa tempest-VolumeDependencyTests-1725326561 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.83f6c6a6-ee58-4884-a343-2f0a32e6b4e6 is being set with open permissions: ugo+rw Apr 27 10:16:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cb0aac5b-db91-4c8c-9702-8ebd8c1a73aa tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.83f6c6a6-ee58-4884-a343-2f0a32e6b4e6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:38 devstack sudo[89943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.83f6c6a6-ee58-4884-a343-2f0a32e6b4e6 Apr 27 10:16:38 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:39 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cb0aac5b-db91-4c8c-9702-8ebd8c1a73aa tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.83f6c6a6-ee58-4884-a343-2f0a32e6b4e6" returned: 0 in 0.438s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:39 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:SELECT=71,cinder:INSERT=29,cinder:UPDATE=78,cinder:DELETE=5 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:16:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cb0aac5b-db91-4c8c-9702-8ebd8c1a73aa tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:39 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.info Apr 27 10:16:39 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:39 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cb0aac5b-db91-4c8c-9702-8ebd8c1a73aa tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.info" returned: 0 in 0.429s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:39 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-cb0aac5b-db91-4c8c-9702-8ebd8c1a73aa tempest-VolumeDependencyTests-1725326561 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.info is being set with open permissions: ugo+rw Apr 27 10:16:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cb0aac5b-db91-4c8c-9702-8ebd8c1a73aa tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:39 devstack sudo[89949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.info Apr 27 10:16:39 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:40 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-cb0aac5b-db91-4c8c-9702-8ebd8c1a73aa tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.info" returned: 0 in 0.428s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-cb0aac5b-db91-4c8c-9702-8ebd8c1a73aa tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.970s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:16:40 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-cb0aac5b-db91-4c8c-9702-8ebd8c1a73aa tempest-VolumeDependencyTests-1725326561 None] Create snapshot completed successfully Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Flow 'volume_create_manager' (65efc7ae-13dc-4232-a400-5971731fa841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0166c8c-ead5-490f-afe4-25421dbcaf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0166c8c-ead5-490f-afe4-25421dbcaf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1574246512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035b8c33-701d-4715-8d24-19414c3a679c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082a38b2a8a4ccf9f4ac1fa0cb2cc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=83f6c6a6-ee58-4884-a343-2f0a32e6b4e6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:16:41Z,use_quota=True,user_id='de9efe45637c4dd2b85c635812f2cef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62514fc2-3c8a-4dde-8e36-126cac45faa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62514fc2-3c8a-4dde-8e36-126cac45faa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04601480-d9aa-46c5-a9a9-8810d827432a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04601480-d9aa-46c5-a9a9-8810d827432a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '035b8c33-701d-4715-8d24-19414c3a679c', 'volume_name': 'volume-035b8c33-701d-4715-8d24-19414c3a679c', 'volume_size': 1, 'snapshot_id': '83f6c6a6-ee58-4884-a343-2f0a32e6b4e6'}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f397b494-5e9d-4882-9d0a-b22c755a6079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f397b494-5e9d-4882-9d0a-b22c755a6079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3aa51ec-68f4-49bc-9006-3803c1c123d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:40 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Volume 035b8c33-701d-4715-8d24-19414c3a679c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-035b8c33-701d-4715-8d24-19414c3a679c', 'volume_size': 1, 'snapshot_id': '83f6c6a6-ee58-4884-a343-2f0a32e6b4e6'} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "cinder-quobyte-83f6c6a6-ee58-4884-a343-2f0a32e6b4e6-035b8c33-701d-4715-8d24-19414c3a679c" by "_create_volume_from_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-quobyte-83f6c6a6-ee58-4884-a343-2f0a32e6b4e6-035b8c33-701d-4715-8d24-19414c3a679c" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Creating volume 035b8c33-701d-4715-8d24-19414c3a679c from snapshot 83f6c6a6-ee58-4884-a343-2f0a32e6b4e6 {{(pid=81350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "cinder-quobyte-035b8c33-701d-4715-8d24-19414c3a679c" by "_copy_volume_from_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-quobyte-035b8c33-701d-4715-8d24-19414c3a679c" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] snapshot: 83f6c6a6-ee58-4884-a343-2f0a32e6b4e6, volume: 035b8c33-701d-4715-8d24-19414c3a679c, {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:16:40 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8880b750-a6d9-4547-b7c4-89d5d864ca99]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:16:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.83f6c6a6-ee58-4884-a343-2f0a32e6b4e6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:41 devstack sudo[89952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.83f6c6a6-ee58-4884-a343-2f0a32e6b4e6 Apr 27 10:16:41 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:41 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.83f6c6a6-ee58-4884-a343-2f0a32e6b4e6" returned: 0 in 0.511s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b04a4aaf-edbc-4daa-9dab-2574fb045047(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:16:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 27 10:16:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Creating direct copy from snapshot {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 27 10:16:41 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7783ee-e589-4ccc-ae53-b56986ba9c44]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:16:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:41 devstack sudo[89957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 Apr 27 10:16:41 devstack sudo[89957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:42 devstack sudo[89957]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047" returned: 0 in 0.501s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:42 devstack cinder-volume[81350]: DEBUG cinder.utils [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Path /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-035b8c33-701d-4715-8d24-19414c3a679c not found in is_blk_device check {{(pid=81350) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 27 10:16:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-035b8c33-701d-4715-8d24-19414c3a679c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:42 devstack sudo[89962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-035b8c33-701d-4715-8d24-19414c3a679c Apr 27 10:16:42 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:46 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-035b8c33-701d-4715-8d24-19414c3a679c" returned: 0 in 4.290s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:46 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e810eb-59df-40c1-91fb-c0c1a1f565d4]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:16:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:46 devstack sudo[89975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 Apr 27 10:16:46 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:46 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047" returned: 0 in 0.614s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:46 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Image conversion details: src /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047, size 1024.00 MB, duration 4.29 sec, destination /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-035b8c33-701d-4715-8d24-19414c3a679c {{(pid=81350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 10:16:46 devstack cinder-volume[81350]: INFO cinder.image.image_utils [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Converted 1024.00 MB image at 238.62 MB/s Apr 27 10:16:46 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-035b8c33-701d-4715-8d24-19414c3a679c is being set with open permissions: ugo+rw Apr 27 10:16:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-035b8c33-701d-4715-8d24-19414c3a679c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:46 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-035b8c33-701d-4715-8d24-19414c3a679c Apr 27 10:16:46 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:47 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-035b8c33-701d-4715-8d24-19414c3a679c" returned: 0 in 0.443s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-quobyte-035b8c33-701d-4715-8d24-19414c3a679c" released by "_copy_volume_from_snapshot" :: held 6.448s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:16:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-quobyte-83f6c6a6-ee58-4884-a343-2f0a32e6b4e6-035b8c33-701d-4715-8d24-19414c3a679c" released by "_create_volume_from_snapshot" :: held 6.482s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:16:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.497s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:16:47 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3aa51ec-68f4-49bc-9006-3803c1c123d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-035b8c33-701d-4715-8d24-19414c3a679c', 'volume_size': 1, 'snapshot_id': '83f6c6a6-ee58-4884-a343-2f0a32e6b4e6'}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:47 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96b8111-5111-4321-af26-bbab4abc772d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:47 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Volume volume-035b8c33-701d-4715-8d24-19414c3a679c (035b8c33-701d-4715-8d24-19414c3a679c): created successfully Apr 27 10:16:47 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96b8111-5111-4321-af26-bbab4abc772d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:47 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Flow 'volume_create_manager' (65efc7ae-13dc-4232-a400-5971731fa841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:16:47 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-be1dbafc-ef1c-4dba-9a72-a59c42075af3 tempest-VolumeDependencyTests-1725326561 None] Created volume successfully. Apr 27 10:16:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-117351b8-4514-42d5-944d-bf247aa94d93 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "cinder-83f6c6a6-ee58-4884-a343-2f0a32e6b4e6-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:16:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-117351b8-4514-42d5-944d-bf247aa94d93 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-83f6c6a6-ee58-4884-a343-2f0a32e6b4e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:16:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-117351b8-4514-42d5-944d-bf247aa94d93 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "cinder-quobyte-b04a4aaf-edbc-4daa-9dab-2574fb045047" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:16:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-117351b8-4514-42d5-944d-bf247aa94d93 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-quobyte-b04a4aaf-edbc-4daa-9dab-2574fb045047" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:16:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-117351b8-4514-42d5-944d-bf247aa94d93 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "cinder-quobyte-83f6c6a6-ee58-4884-a343-2f0a32e6b4e6" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:16:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-117351b8-4514-42d5-944d-bf247aa94d93 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-quobyte-83f6c6a6-ee58-4884-a343-2f0a32e6b4e6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:16:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-117351b8-4514-42d5-944d-bf247aa94d93 tempest-VolumeDependencyTests-1725326561 None] Deleting offline snapshot 83f6c6a6-ee58-4884-a343-2f0a32e6b4e6 of volume b04a4aaf-edbc-4daa-9dab-2574fb045047 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:16:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-117351b8-4514-42d5-944d-bf247aa94d93 tempest-VolumeDependencyTests-1725326561 None] snapshot_file for this snap is: volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.83f6c6a6-ee58-4884-a343-2f0a32e6b4e6 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:16:48 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7db821-379c-46a9-ad2c-a113ba42c094]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:16:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-117351b8-4514-42d5-944d-bf247aa94d93 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.83f6c6a6-ee58-4884-a343-2f0a32e6b4e6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:48 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.83f6c6a6-ee58-4884-a343-2f0a32e6b4e6 Apr 27 10:16:48 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:48 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-117351b8-4514-42d5-944d-bf247aa94d93 tempest-VolumeDependencyTests-1725326561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.83f6c6a6-ee58-4884-a343-2f0a32e6b4e6" returned: 0 in 0.500s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-117351b8-4514-42d5-944d-bf247aa94d93 tempest-VolumeDependencyTests-1725326561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b04a4aaf-edbc-4daa-9dab-2574fb045047(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:16:48 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75a3921-612e-4a6e-9711-36ec025d4425]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:16:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-117351b8-4514-42d5-944d-bf247aa94d93 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:49 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 Apr 27 10:16:49 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:49 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-117351b8-4514-42d5-944d-bf247aa94d93 tempest-VolumeDependencyTests-1725326561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047" returned: 0 in 0.506s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-117351b8-4514-42d5-944d-bf247aa94d93 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.83f6c6a6-ee58-4884-a343-2f0a32e6b4e6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:49 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.83f6c6a6-ee58-4884-a343-2f0a32e6b4e6 Apr 27 10:16:49 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:50 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-117351b8-4514-42d5-944d-bf247aa94d93 tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.83f6c6a6-ee58-4884-a343-2f0a32e6b4e6" returned: 0 in 0.531s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-117351b8-4514-42d5-944d-bf247aa94d93 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.83f6c6a6-ee58-4884-a343-2f0a32e6b4e6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:50 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.83f6c6a6-ee58-4884-a343-2f0a32e6b4e6 Apr 27 10:16:50 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:50 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-117351b8-4514-42d5-944d-bf247aa94d93 tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047.83f6c6a6-ee58-4884-a343-2f0a32e6b4e6" returned: 0 in 0.439s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:50 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-117351b8-4514-42d5-944d-bf247aa94d93 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-quobyte-83f6c6a6-ee58-4884-a343-2f0a32e6b4e6" released by "_delete_snapshot" :: held 2.070s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:16:50 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-117351b8-4514-42d5-944d-bf247aa94d93 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-quobyte-b04a4aaf-edbc-4daa-9dab-2574fb045047" released by "delete_snapshot" :: held 2.096s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:16:50 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-117351b8-4514-42d5-944d-bf247aa94d93 tempest-VolumeDependencyTests-1725326561 None] Created reservations ['7dced268-b12b-4a8f-99a8-1a503c71bede', '2d5db6f6-72de-4874-90bf-a7aa5630ec6c', 'd739a3c7-183d-4630-ba48-04a74b0ef88d', 'c2dbe578-8ac3-4181-997c-d8195ab29dfa'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:16:50 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-117351b8-4514-42d5-944d-bf247aa94d93 tempest-VolumeDependencyTests-1725326561 None] Delete snapshot completed successfully. Apr 27 10:16:50 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-117351b8-4514-42d5-944d-bf247aa94d93 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-83f6c6a6-ee58-4884-a343-2f0a32e6b4e6-delete_snapshot" released by "delete_snapshot" :: held 2.225s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:16:51 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8c51cecf-c09f-4267-b7c3-d078e464ac51 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "cinder-b04a4aaf-edbc-4daa-9dab-2574fb045047-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:16:51 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8c51cecf-c09f-4267-b7c3-d078e464ac51 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-b04a4aaf-edbc-4daa-9dab-2574fb045047-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:16:51 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8c51cecf-c09f-4267-b7c3-d078e464ac51 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "cinder-quobyte-b04a4aaf-edbc-4daa-9dab-2574fb045047" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:16:51 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8c51cecf-c09f-4267-b7c3-d078e464ac51 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-quobyte-b04a4aaf-edbc-4daa-9dab-2574fb045047" acquired by "delete_volume" :: waited 0.014s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:16:51 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e992f2b2-8152-43f2-9cb7-4696f6e151f3]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:16:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c51cecf-c09f-4267-b7c3-d078e464ac51 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:51 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 Apr 27 10:16:51 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:52 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c51cecf-c09f-4267-b7c3-d078e464ac51 tempest-VolumeDependencyTests-1725326561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047" returned: 0 in 0.515s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c51cecf-c09f-4267-b7c3-d078e464ac51 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:52 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047 Apr 27 10:16:52 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:52 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c51cecf-c09f-4267-b7c3-d078e464ac51 tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b04a4aaf-edbc-4daa-9dab-2574fb045047" returned: 0 in 0.448s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:52 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8c51cecf-c09f-4267-b7c3-d078e464ac51 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-quobyte-b04a4aaf-edbc-4daa-9dab-2574fb045047" released by "delete_volume" :: held 1.020s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:16:52 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-8c51cecf-c09f-4267-b7c3-d078e464ac51 tempest-VolumeDependencyTests-1725326561 None] Created reservations ['7feb8516-7fc3-42f4-a0b4-356aabb006aa', 'a768e2ba-5086-43df-9cb8-5d3e78a5163e', 'fc8b87e8-52c6-4fdd-af1a-64d3a9497b5a', '065be97f-db7c-4b2e-9858-79fd7b12ed84'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:16:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8c51cecf-c09f-4267-b7c3-d078e464ac51 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:16:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8c51cecf-c09f-4267-b7c3-d078e464ac51 tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:16:52 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8c51cecf-c09f-4267-b7c3-d078e464ac51 tempest-VolumeDependencyTests-1725326561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:16:52 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8c51cecf-c09f-4267-b7c3-d078e464ac51 tempest-VolumeDependencyTests-1725326561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:16:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8c51cecf-c09f-4267-b7c3-d078e464ac51 tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:16:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c51cecf-c09f-4267-b7c3-d078e464ac51 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:52 devstack sudo[90009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:16:52 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:53 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c51cecf-c09f-4267-b7c3-d078e464ac51 tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.455s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:53 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-8c51cecf-c09f-4267-b7c3-d078e464ac51 tempest-VolumeDependencyTests-1725326561 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:16:53 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-8c51cecf-c09f-4267-b7c3-d078e464ac51 tempest-VolumeDependencyTests-1725326561 None] Deleted volume successfully. Apr 27 10:16:53 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8c51cecf-c09f-4267-b7c3-d078e464ac51 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-b04a4aaf-edbc-4daa-9dab-2574fb045047-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:16:54 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:16:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Flow 'volume_create_manager' (7215a3e2-59f7-466e-a0cd-2b15e53e574b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:16:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52cd81a-6289-424e-a670-cad7b41f1a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52cd81a-6289-424e-a670-cad7b41f1a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-87580878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b4a640-eea4-4075-95de-6bb3cd1012c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082a38b2a8a4ccf9f4ac1fa0cb2cc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:16:54Z,use_quota=True,user_id='de9efe45637c4dd2b85c635812f2cef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1fcb46e-1dfd-4f12-939d-c94b8cfd84a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1fcb46e-1dfd-4f12-939d-c94b8cfd84a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0dbcd9b-7646-48ff-8581-b054180878c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0dbcd9b-7646-48ff-8581-b054180878c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06b4a640-eea4-4075-95de-6bb3cd1012c6', 'volume_name': 'volume-06b4a640-eea4-4075-95de-6bb3cd1012c6', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc2e251-11d3-4a17-9ab8-67a5d25031d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc2e251-11d3-4a17-9ab8-67a5d25031d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a5ac51-c885-44ee-91be-fc422a03597c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:54 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Volume 06b4a640-eea4-4075-95de-6bb3cd1012c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06b4a640-eea4-4075-95de-6bb3cd1012c6', 'volume_size': 1} Apr 27 10:16:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:16:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:16:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-87580878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b4a640-eea4-4075-95de-6bb3cd1012c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082a38b2a8a4ccf9f4ac1fa0cb2cc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:16:54Z,use_quota=True,user_id='de9efe45637c4dd2b85c635812f2cef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:16:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Creating volume 06b4a640-eea4-4075-95de-6bb3cd1012c6 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:16:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:16:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:16:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:16:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:16:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:16:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:16:54 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:16:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:54 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 1073741824 Apr 27 10:16:54 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:54 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 1073741824" returned: 0 in 0.600s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:54 devstack sudo[90018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 Apr 27 10:16:54 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:55 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6" returned: 0 in 0.430s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:55 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:16:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:16:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a5ac51-c885-44ee-91be-fc422a03597c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06b4a640-eea4-4075-95de-6bb3cd1012c6', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec32a323-0041-4233-a3e9-9f835adc6477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:55 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Volume volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 (06b4a640-eea4-4075-95de-6bb3cd1012c6): created successfully Apr 27 10:16:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec32a323-0041-4233-a3e9-9f835adc6477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Flow 'volume_create_manager' (7215a3e2-59f7-466e-a0cd-2b15e53e574b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:16:55 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-3a5ac82c-00be-455e-b346-6a813cb578e9 tempest-VolumeDependencyTests-1725326561 None] Created volume successfully. Apr 27 10:16:56 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:16:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Flow 'volume_create_manager' (8ca8e306-3e9a-4c50-83b1-6d7e7ae3d00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:16:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b0998b-f602-4c9e-83dd-e8c17f7d7a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b0998b-f602-4c9e-83dd-e8c17f7d7a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1708649343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861cfa45-dfc4-42c5-98ee-fd6fb8267ee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082a38b2a8a4ccf9f4ac1fa0cb2cc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=06b4a640-eea4-4075-95de-6bb3cd1012c6,status='creating',terminated_at=None,updated_at=2026-04-27T08:16:56Z,use_quota=True,user_id='de9efe45637c4dd2b85c635812f2cef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae7f3db3-c39a-4292-bf8c-3b96033a0715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae7f3db3-c39a-4292-bf8c-3b96033a0715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6aae96-a1f2-4cf9-abdf-aed96e83a0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6aae96-a1f2-4cf9-abdf-aed96e83a0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '861cfa45-dfc4-42c5-98ee-fd6fb8267ee8', 'volume_name': 'volume-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8', 'volume_size': 1, 'source_volid': '06b4a640-eea4-4075-95de-6bb3cd1012c6', 'source_volstatus': 'available'}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a45548-3e06-4e8d-8213-83c646cfe6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a45548-3e06-4e8d-8213-83c646cfe6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:16:56 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7118e8ed-59b7-4ba3-afa8-a6d08b4794f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:16:56 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Volume 861cfa45-dfc4-42c5-98ee-fd6fb8267ee8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8', 'volume_size': 1, 'source_volid': '06b4a640-eea4-4075-95de-6bb3cd1012c6', 'source_volstatus': 'available'} Apr 27 10:16:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:16:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:16:56 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Cloning volume 06b4a640-eea4-4075-95de-6bb3cd1012c6 to volume 861cfa45-dfc4-42c5-98ee-fd6fb8267ee8 Apr 27 10:16:56 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Creating offline snapshot fbfb2181-82cb-491d-b832-11e05c83e080 of volume 06b4a640-eea4-4075-95de-6bb3cd1012c6 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:16:56 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c38a742-a811-49fb-8907-305b9193e397]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:16:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:56 devstack sudo[90021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 Apr 27 10:16:56 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:57 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6" returned: 0 in 0.520s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.fbfb2181-82cb-491d-b832-11e05c83e080 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:57 devstack sudo[90026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.fbfb2181-82cb-491d-b832-11e05c83e080 1G Apr 27 10:16:57 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:57 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.fbfb2181-82cb-491d-b832-11e05c83e080 1G" returned: 0 in 0.583s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.fbfb2181-82cb-491d-b832-11e05c83e080 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:57 devstack sudo[90065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.fbfb2181-82cb-491d-b832-11e05c83e080 Apr 27 10:16:57 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:58 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.fbfb2181-82cb-491d-b832-11e05c83e080" returned: 0 in 0.464s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:58 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.fbfb2181-82cb-491d-b832-11e05c83e080 is being set with open permissions: ugo+rw Apr 27 10:16:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.fbfb2181-82cb-491d-b832-11e05c83e080 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:58 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.fbfb2181-82cb-491d-b832-11e05c83e080 Apr 27 10:16:58 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:58 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.fbfb2181-82cb-491d-b832-11e05c83e080" returned: 0 in 0.433s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:58 devstack sudo[90073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.info Apr 27 10:16:58 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:59 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.info" returned: 0 in 0.428s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:59 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.info is being set with open permissions: ugo+rw Apr 27 10:16:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:59 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.info Apr 27 10:16:59 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:16:59 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Apr 27 10:16:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.info" returned: 0 in 0.437s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:16:59 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "cinder-quobyte-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8" by "_copy_volume_from_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:16:59 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-quobyte-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:16:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] snapshot: fbfb2181-82cb-491d-b832-11e05c83e080, volume: 861cfa45-dfc4-42c5-98ee-fd6fb8267ee8, {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 27 10:16:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:16:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:16:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:16:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:16:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:16:59 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20af46a-9876-4cb3-b653-b7b9f0ca294b]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:16:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.fbfb2181-82cb-491d-b832-11e05c83e080 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:16:59 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.fbfb2181-82cb-491d-b832-11e05c83e080 Apr 27 10:16:59 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:00 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.fbfb2181-82cb-491d-b832-11e05c83e080" returned: 0 in 0.498s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:00 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06b4a640-eea4-4075-95de-6bb3cd1012c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:17:00 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 27 10:17:00 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Creating direct copy from snapshot {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 27 10:17:00 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[7888d240-9de7-418d-8095-6df14eeb8527]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:17:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:00 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 Apr 27 10:17:00 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:00 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6" returned: 0 in 0.501s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:00 devstack cinder-volume[81350]: DEBUG cinder.utils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Path /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8 not found in is_blk_device check {{(pid=81350) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 27 10:17:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:00 devstack sudo[90089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8 Apr 27 10:17:00 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:04 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8" returned: 0 in 4.291s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:04 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[785dab20-a618-43fb-8912-28573f425678]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:17:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:05 devstack sudo[90105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 Apr 27 10:17:05 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:05 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6" returned: 0 in 0.644s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:05 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Image conversion details: src /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6, size 1024.00 MB, duration 4.29 sec, destination /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8 {{(pid=81350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 10:17:05 devstack cinder-volume[81350]: INFO cinder.image.image_utils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Converted 1024.00 MB image at 238.55 MB/s Apr 27 10:17:05 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8 is being set with open permissions: ugo+rw Apr 27 10:17:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:05 devstack sudo[90110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8 Apr 27 10:17:05 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:06 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8" returned: 0 in 0.422s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-quobyte-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8" released by "_copy_volume_from_snapshot" :: held 6.429s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:17:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "cinder-quobyte-fbfb2181-82cb-491d-b832-11e05c83e080" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:17:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-quobyte-fbfb2181-82cb-491d-b832-11e05c83e080" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:17:06 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Deleting offline snapshot fbfb2181-82cb-491d-b832-11e05c83e080 of volume 06b4a640-eea4-4075-95de-6bb3cd1012c6 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:17:06 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] snapshot_file for this snap is: volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.fbfb2181-82cb-491d-b832-11e05c83e080 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:17:06 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c384fd-497d-4f6b-9da3-b1f639665202]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:17:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.fbfb2181-82cb-491d-b832-11e05c83e080 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:06 devstack sudo[90113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.fbfb2181-82cb-491d-b832-11e05c83e080 Apr 27 10:17:06 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:06 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.fbfb2181-82cb-491d-b832-11e05c83e080" returned: 0 in 0.538s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:06 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06b4a640-eea4-4075-95de-6bb3cd1012c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:17:06 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0921ae29-d47c-4e0f-8027-74e31602f993]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:17:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:06 devstack sudo[90118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 Apr 27 10:17:06 devstack sudo[90118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:07 devstack sudo[90118]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6" returned: 0 in 0.486s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.fbfb2181-82cb-491d-b832-11e05c83e080 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:07 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.fbfb2181-82cb-491d-b832-11e05c83e080 Apr 27 10:17:07 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:07 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.fbfb2181-82cb-491d-b832-11e05c83e080" returned: 0 in 0.549s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.fbfb2181-82cb-491d-b832-11e05c83e080 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:07 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.fbfb2181-82cb-491d-b832-11e05c83e080 Apr 27 10:17:07 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:08 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6.fbfb2181-82cb-491d-b832-11e05c83e080" returned: 0 in 0.423s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-quobyte-fbfb2181-82cb-491d-b832-11e05c83e080" released by "_delete_snapshot" :: held 2.085s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:17:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.567s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:17:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7118e8ed-59b7-4ba3-afa8-a6d08b4794f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8', 'volume_size': 1, 'source_volid': '06b4a640-eea4-4075-95de-6bb3cd1012c6', 'source_volstatus': 'available'}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:17:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08327eae-bd2a-4e55-8d3c-c794a2c400db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:17:08 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Volume volume-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8 (861cfa45-dfc4-42c5-98ee-fd6fb8267ee8): created successfully Apr 27 10:17:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08327eae-bd2a-4e55-8d3c-c794a2c400db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:17:08 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Flow 'volume_create_manager' (8ca8e306-3e9a-4c50-83b1-6d7e7ae3d00f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:17:08 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-c55b6770-7f6a-4741-b12c-a7261fba0310 tempest-VolumeDependencyTests-1725326561 None] Created volume successfully. Apr 27 10:17:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b695f20a-83d0-4786-b94f-b0e8d82480e9 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "cinder-06b4a640-eea4-4075-95de-6bb3cd1012c6-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:17:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b695f20a-83d0-4786-b94f-b0e8d82480e9 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-06b4a640-eea4-4075-95de-6bb3cd1012c6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:17:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b695f20a-83d0-4786-b94f-b0e8d82480e9 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "cinder-quobyte-06b4a640-eea4-4075-95de-6bb3cd1012c6" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:17:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b695f20a-83d0-4786-b94f-b0e8d82480e9 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-quobyte-06b4a640-eea4-4075-95de-6bb3cd1012c6" acquired by "delete_volume" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:17:08 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af453b3-9d21-44f7-8fd1-8d24b61bf19e]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:17:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b695f20a-83d0-4786-b94f-b0e8d82480e9 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:08 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 Apr 27 10:17:08 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:09 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b695f20a-83d0-4786-b94f-b0e8d82480e9 tempest-VolumeDependencyTests-1725326561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6" returned: 0 in 0.498s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b695f20a-83d0-4786-b94f-b0e8d82480e9 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:09 devstack sudo[90136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6 Apr 27 10:17:09 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:09 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b695f20a-83d0-4786-b94f-b0e8d82480e9 tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06b4a640-eea4-4075-95de-6bb3cd1012c6" returned: 0 in 0.421s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:09 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b695f20a-83d0-4786-b94f-b0e8d82480e9 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-quobyte-06b4a640-eea4-4075-95de-6bb3cd1012c6" released by "delete_volume" :: held 0.979s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:17:09 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-b695f20a-83d0-4786-b94f-b0e8d82480e9 tempest-VolumeDependencyTests-1725326561 None] Created reservations ['b8c5eb0c-a462-4a05-b28a-679ef8b91a7b', '5ce840d3-c376-43b6-95c5-9fbbe4ef96fa', '1e2522c7-5cda-47df-9a1c-2e241c6c6979', '113025b1-e9e5-4ab5-84ff-1911eba9f954'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:17:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b695f20a-83d0-4786-b94f-b0e8d82480e9 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:17:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b695f20a-83d0-4786-b94f-b0e8d82480e9 tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:17:09 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b695f20a-83d0-4786-b94f-b0e8d82480e9 tempest-VolumeDependencyTests-1725326561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:17:09 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b695f20a-83d0-4786-b94f-b0e8d82480e9 tempest-VolumeDependencyTests-1725326561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:17:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b695f20a-83d0-4786-b94f-b0e8d82480e9 tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:17:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b695f20a-83d0-4786-b94f-b0e8d82480e9 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:09 devstack sudo[90139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:17:09 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:09 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b695f20a-83d0-4786-b94f-b0e8d82480e9 tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.430s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:09 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-b695f20a-83d0-4786-b94f-b0e8d82480e9 tempest-VolumeDependencyTests-1725326561 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:17:10 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-b695f20a-83d0-4786-b94f-b0e8d82480e9 tempest-VolumeDependencyTests-1725326561 None] Deleted volume successfully. Apr 27 10:17:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b695f20a-83d0-4786-b94f-b0e8d82480e9 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-06b4a640-eea4-4075-95de-6bb3cd1012c6-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:17:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-98d62b53-312c-4504-bf9e-6b35a224bd4e tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "cinder-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:17:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-98d62b53-312c-4504-bf9e-6b35a224bd4e tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:17:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-98d62b53-312c-4504-bf9e-6b35a224bd4e tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "cinder-quobyte-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:17:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-98d62b53-312c-4504-bf9e-6b35a224bd4e tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-quobyte-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8" acquired by "delete_volume" :: waited 0.013s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:17:10 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a9f77f-3171-4415-ade9-9e0f1a1c46ca]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:17:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-98d62b53-312c-4504-bf9e-6b35a224bd4e tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:10 devstack sudo[90142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8 Apr 27 10:17:10 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:11 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-98d62b53-312c-4504-bf9e-6b35a224bd4e tempest-VolumeDependencyTests-1725326561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8" returned: 0 in 0.497s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-98d62b53-312c-4504-bf9e-6b35a224bd4e tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:11 devstack sudo[90147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8 Apr 27 10:17:11 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:11 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-98d62b53-312c-4504-bf9e-6b35a224bd4e tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8" returned: 0 in 0.439s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-98d62b53-312c-4504-bf9e-6b35a224bd4e tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-quobyte-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8" released by "delete_volume" :: held 0.975s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:17:11 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-98d62b53-312c-4504-bf9e-6b35a224bd4e tempest-VolumeDependencyTests-1725326561 None] Created reservations ['a46d6a2f-291e-44f9-9219-af85cc5dd180', 'e5643273-1f34-41ea-bb65-a568bc5c6949', '79a2cce0-07b1-4e31-a68f-5a6d316ea016', 'a6094856-f1dc-41f9-9c9d-5ddf0237cccd'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:17:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-98d62b53-312c-4504-bf9e-6b35a224bd4e tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:17:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-98d62b53-312c-4504-bf9e-6b35a224bd4e tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:17:11 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-98d62b53-312c-4504-bf9e-6b35a224bd4e tempest-VolumeDependencyTests-1725326561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:17:11 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-98d62b53-312c-4504-bf9e-6b35a224bd4e tempest-VolumeDependencyTests-1725326561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:17:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-98d62b53-312c-4504-bf9e-6b35a224bd4e tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:17:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-98d62b53-312c-4504-bf9e-6b35a224bd4e tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:11 devstack sudo[90150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:17:11 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:12 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-98d62b53-312c-4504-bf9e-6b35a224bd4e tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.438s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:12 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-98d62b53-312c-4504-bf9e-6b35a224bd4e tempest-VolumeDependencyTests-1725326561 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:17:12 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-98d62b53-312c-4504-bf9e-6b35a224bd4e tempest-VolumeDependencyTests-1725326561 None] Deleted volume successfully. Apr 27 10:17:12 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-98d62b53-312c-4504-bf9e-6b35a224bd4e tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-861cfa45-dfc4-42c5-98ee-fd6fb8267ee8-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:17:12 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-dd034b2e-a202-433f-8b24-89a299b450e1 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "cinder-035b8c33-701d-4715-8d24-19414c3a679c-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:17:12 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-dd034b2e-a202-433f-8b24-89a299b450e1 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-035b8c33-701d-4715-8d24-19414c3a679c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:17:12 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-dd034b2e-a202-433f-8b24-89a299b450e1 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "cinder-quobyte-035b8c33-701d-4715-8d24-19414c3a679c" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:17:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-dd034b2e-a202-433f-8b24-89a299b450e1 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-quobyte-035b8c33-701d-4715-8d24-19414c3a679c" acquired by "delete_volume" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:17:13 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6df463-9fab-4a6f-a2ca-abffa7f255aa]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:17:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-dd034b2e-a202-433f-8b24-89a299b450e1 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-035b8c33-701d-4715-8d24-19414c3a679c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:13 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-035b8c33-701d-4715-8d24-19414c3a679c Apr 27 10:17:13 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:13 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-dd034b2e-a202-433f-8b24-89a299b450e1 tempest-VolumeDependencyTests-1725326561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-035b8c33-701d-4715-8d24-19414c3a679c" returned: 0 in 0.507s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-dd034b2e-a202-433f-8b24-89a299b450e1 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-035b8c33-701d-4715-8d24-19414c3a679c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:13 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-035b8c33-701d-4715-8d24-19414c3a679c Apr 27 10:17:13 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:13 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-dd034b2e-a202-433f-8b24-89a299b450e1 tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-035b8c33-701d-4715-8d24-19414c3a679c" returned: 0 in 0.435s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-dd034b2e-a202-433f-8b24-89a299b450e1 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-quobyte-035b8c33-701d-4715-8d24-19414c3a679c" released by "delete_volume" :: held 0.979s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:17:14 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-dd034b2e-a202-433f-8b24-89a299b450e1 tempest-VolumeDependencyTests-1725326561 None] Created reservations ['c0f5285a-5ec3-4e74-8343-480c47a3e724', 'b37c7798-e10a-4205-be15-745b01ff42ad', '789f8c96-13b9-4203-990e-8d8eea6c7995', '20aca8f3-9f33-4647-9238-f9051955d713'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:17:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-dd034b2e-a202-433f-8b24-89a299b450e1 tempest-VolumeDependencyTests-1725326561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:17:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-dd034b2e-a202-433f-8b24-89a299b450e1 tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:17:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-dd034b2e-a202-433f-8b24-89a299b450e1 tempest-VolumeDependencyTests-1725326561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:17:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-dd034b2e-a202-433f-8b24-89a299b450e1 tempest-VolumeDependencyTests-1725326561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:17:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-dd034b2e-a202-433f-8b24-89a299b450e1 tempest-VolumeDependencyTests-1725326561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:17:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-dd034b2e-a202-433f-8b24-89a299b450e1 tempest-VolumeDependencyTests-1725326561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:14 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:17:14 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:14 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-dd034b2e-a202-433f-8b24-89a299b450e1 tempest-VolumeDependencyTests-1725326561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.446s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:14 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-dd034b2e-a202-433f-8b24-89a299b450e1 tempest-VolumeDependencyTests-1725326561 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:17:14 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-dd034b2e-a202-433f-8b24-89a299b450e1 tempest-VolumeDependencyTests-1725326561 None] Deleted volume successfully. Apr 27 10:17:14 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-dd034b2e-a202-433f-8b24-89a299b450e1 tempest-VolumeDependencyTests-1725326561 None] Lock "cinder-035b8c33-701d-4715-8d24-19414c3a679c-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:17:16 devstack cinder-volume[81350]: DEBUG oslo_service.periodic_task [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81350) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 10:17:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:17:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:17:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:17:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:17:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:17:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:16 devstack sudo[90172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:17:16 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:17 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.497s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:17 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:17:24 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:SELECT=35,cinder:UPDATE=45,cinder:INSERT=17,cinder:DELETE=1 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:17:24 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:SELECT=51,cinder:INSERT=12,cinder:UPDATE=68,cinder:DELETE=9 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:17:34 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:17:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Flow 'volume_create_manager' (36a4ab78-67d6-453a-9e12-e12ab5cedae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:17:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3771858-e445-4c8b-a93c-49f7e261f6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:17:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3771858-e445-4c8b-a93c-49f7e261f6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1019920279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6cbbf65-e5b5-4d4d-9228-701a10d84cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9c38770bba44b6a136d80a5975ccc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:17:35Z,use_quota=True,user_id='2408a3875b214cd9ae6363621e69ad71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:17:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2818cf2b-4e4d-44f7-9362-e8c07ee0202b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:17:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2818cf2b-4e4d-44f7-9362-e8c07ee0202b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:17:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55bb09cc-799b-480c-aa09-5a6a68c84f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:17:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55bb09cc-799b-480c-aa09-5a6a68c84f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6cbbf65-e5b5-4d4d-9228-701a10d84cf8', 'volume_name': 'volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:17:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c63dfab-e0b2-49bd-8f2f-dcf7a8c56d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:17:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c63dfab-e0b2-49bd-8f2f-dcf7a8c56d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:17:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8fe73a-d6ea-420c-a7a4-bb057258a888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:17:34 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Volume b6cbbf65-e5b5-4d4d-9228-701a10d84cf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8', 'volume_size': 1} Apr 27 10:17:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:17:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:17:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1019920279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6cbbf65-e5b5-4d4d-9228-701a10d84cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9c38770bba44b6a136d80a5975ccc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:17:35Z,use_quota=True,user_id='2408a3875b214cd9ae6363621e69ad71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:17:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Creating volume b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:17:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:17:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:17:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:17:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:17:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:17:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:17:34 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:17:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:34 devstack sudo[90180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 1073741824 Apr 27 10:17:34 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:35 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 1073741824" returned: 0 in 0.583s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:35 devstack sudo[90185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 Apr 27 10:17:35 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:35 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8" returned: 0 in 0.437s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:17:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:17:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8fe73a-d6ea-420c-a7a4-bb057258a888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:17:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36321ccc-dec4-4e4a-86dc-cd45011ee1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:17:35 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Volume volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 (b6cbbf65-e5b5-4d4d-9228-701a10d84cf8): created successfully Apr 27 10:17:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36321ccc-dec4-4e4a-86dc-cd45011ee1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:17:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Flow 'volume_create_manager' (36a4ab78-67d6-453a-9e12-e12ab5cedae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:17:35 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-1d469049-12cd-49ae-acba-e596b44eb829 tempest-SnapshotDependencyTests-1712512900 None] Created volume successfully. Apr 27 10:17:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-a9371b6a-8865-4cc9-a9cd-3f3304c799ea tempest-SnapshotDependencyTests-1712512900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:17:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-a9371b6a-8865-4cc9-a9cd-3f3304c799ea tempest-SnapshotDependencyTests-1712512900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:17:37 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-a9371b6a-8865-4cc9-a9cd-3f3304c799ea tempest-SnapshotDependencyTests-1712512900 None] Creating offline snapshot 7548d058-97dd-4c5f-ab05-4b901a70c653 of volume b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:17:37 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[26545fe6-fc9e-46de-a90f-988f91f4b8ff]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:17:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a9371b6a-8865-4cc9-a9cd-3f3304c799ea tempest-SnapshotDependencyTests-1712512900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:37 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 Apr 27 10:17:37 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:37 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a9371b6a-8865-4cc9-a9cd-3f3304c799ea tempest-SnapshotDependencyTests-1712512900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8" returned: 0 in 0.528s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a9371b6a-8865-4cc9-a9cd-3f3304c799ea tempest-SnapshotDependencyTests-1712512900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.7548d058-97dd-4c5f-ab05-4b901a70c653 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:37 devstack sudo[90193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.7548d058-97dd-4c5f-ab05-4b901a70c653 1G Apr 27 10:17:37 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:38 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a9371b6a-8865-4cc9-a9cd-3f3304c799ea tempest-SnapshotDependencyTests-1712512900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.7548d058-97dd-4c5f-ab05-4b901a70c653 1G" returned: 0 in 0.590s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a9371b6a-8865-4cc9-a9cd-3f3304c799ea tempest-SnapshotDependencyTests-1712512900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.7548d058-97dd-4c5f-ab05-4b901a70c653 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:38 devstack sudo[90198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.7548d058-97dd-4c5f-ab05-4b901a70c653 Apr 27 10:17:38 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:38 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a9371b6a-8865-4cc9-a9cd-3f3304c799ea tempest-SnapshotDependencyTests-1712512900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.7548d058-97dd-4c5f-ab05-4b901a70c653" returned: 0 in 0.488s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:38 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-a9371b6a-8865-4cc9-a9cd-3f3304c799ea tempest-SnapshotDependencyTests-1712512900 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.7548d058-97dd-4c5f-ab05-4b901a70c653 is being set with open permissions: ugo+rw Apr 27 10:17:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a9371b6a-8865-4cc9-a9cd-3f3304c799ea tempest-SnapshotDependencyTests-1712512900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.7548d058-97dd-4c5f-ab05-4b901a70c653 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:38 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.7548d058-97dd-4c5f-ab05-4b901a70c653 Apr 27 10:17:38 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:39 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a9371b6a-8865-4cc9-a9cd-3f3304c799ea tempest-SnapshotDependencyTests-1712512900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.7548d058-97dd-4c5f-ab05-4b901a70c653" returned: 0 in 0.471s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a9371b6a-8865-4cc9-a9cd-3f3304c799ea tempest-SnapshotDependencyTests-1712512900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:39 devstack sudo[90206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.info Apr 27 10:17:39 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:39 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a9371b6a-8865-4cc9-a9cd-3f3304c799ea tempest-SnapshotDependencyTests-1712512900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.info" returned: 0 in 0.448s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:39 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-a9371b6a-8865-4cc9-a9cd-3f3304c799ea tempest-SnapshotDependencyTests-1712512900 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.info is being set with open permissions: ugo+rw Apr 27 10:17:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a9371b6a-8865-4cc9-a9cd-3f3304c799ea tempest-SnapshotDependencyTests-1712512900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:39 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.info Apr 27 10:17:39 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:40 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a9371b6a-8865-4cc9-a9cd-3f3304c799ea tempest-SnapshotDependencyTests-1712512900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.info" returned: 0 in 0.442s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-a9371b6a-8865-4cc9-a9cd-3f3304c799ea tempest-SnapshotDependencyTests-1712512900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.057s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:17:40 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-a9371b6a-8865-4cc9-a9cd-3f3304c799ea tempest-SnapshotDependencyTests-1712512900 None] Create snapshot completed successfully Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Flow 'volume_create_manager' (35a71aa4-f0b9-4d05-928b-671537732d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1058ed4c-3a8d-44f1-b808-5e3929d4a4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1058ed4c-3a8d-44f1-b808-5e3929d4a4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f0a7eed-f16d-42d9-8128-c3ecf3e813c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9c38770bba44b6a136d80a5975ccc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7548d058-97dd-4c5f-ab05-4b901a70c653,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:17:42Z,use_quota=True,user_id='2408a3875b214cd9ae6363621e69ad71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec1b8179-27d5-4b02-a8b3-ecacea60121a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec1b8179-27d5-4b02-a8b3-ecacea60121a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88136ffa-bbd7-426b-863c-83baca21f1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88136ffa-bbd7-426b-863c-83baca21f1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6f0a7eed-f16d-42d9-8128-c3ecf3e813c6', 'volume_name': 'volume-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6', 'volume_size': 1, 'snapshot_id': '7548d058-97dd-4c5f-ab05-4b901a70c653'}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5695833d-54c1-4a6e-ae81-a65ac8246150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5695833d-54c1-4a6e-ae81-a65ac8246150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b96b9d-53e3-4d4d-ada4-a79bf9af47dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:17:41 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Volume 6f0a7eed-f16d-42d9-8128-c3ecf3e813c6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6', 'volume_size': 1, 'snapshot_id': '7548d058-97dd-4c5f-ab05-4b901a70c653'} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Acquiring lock "cinder-quobyte-7548d058-97dd-4c5f-ab05-4b901a70c653-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6" by "_create_volume_from_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Lock "cinder-quobyte-7548d058-97dd-4c5f-ab05-4b901a70c653-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Creating volume 6f0a7eed-f16d-42d9-8128-c3ecf3e813c6 from snapshot 7548d058-97dd-4c5f-ab05-4b901a70c653 {{(pid=81350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Acquiring lock "cinder-quobyte-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6" by "_copy_volume_from_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Lock "cinder-quobyte-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] snapshot: 7548d058-97dd-4c5f-ab05-4b901a70c653, volume: 6f0a7eed-f16d-42d9-8128-c3ecf3e813c6, {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c7158c-004f-4067-bf84-f141bab5154a]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:17:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.7548d058-97dd-4c5f-ab05-4b901a70c653 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:41 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.7548d058-97dd-4c5f-ab05-4b901a70c653 Apr 27 10:17:41 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:42 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.7548d058-97dd-4c5f-ab05-4b901a70c653" returned: 0 in 0.538s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:42 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:17:42 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 27 10:17:42 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Creating direct copy from snapshot {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 27 10:17:42 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af5babf-2bc3-4dca-a3b2-613c5ccae2eb]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:17:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:42 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 Apr 27 10:17:42 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:42 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8" returned: 0 in 0.519s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:42 devstack cinder-volume[81350]: DEBUG cinder.utils [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Path /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6 not found in is_blk_device check {{(pid=81350) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 27 10:17:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:42 devstack sudo[90222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6 Apr 27 10:17:42 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:47 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6" returned: 0 in 4.397s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:47 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e30d050-334a-4e64-b279-d25469f0f92a]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:17:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:47 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 Apr 27 10:17:47 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:47 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8" returned: 0 in 0.627s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:47 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Image conversion details: src /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8, size 1024.00 MB, duration 4.40 sec, destination /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6 {{(pid=81350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 10:17:47 devstack cinder-volume[81350]: INFO cinder.image.image_utils [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Converted 1024.00 MB image at 232.84 MB/s Apr 27 10:17:47 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6 is being set with open permissions: ugo+rw Apr 27 10:17:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:47 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6 Apr 27 10:17:47 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:48 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6" returned: 0 in 0.427s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Lock "cinder-quobyte-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6" released by "_copy_volume_from_snapshot" :: held 6.601s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:17:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Lock "cinder-quobyte-7548d058-97dd-4c5f-ab05-4b901a70c653-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6" released by "_create_volume_from_snapshot" :: held 6.630s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:17:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.644s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:17:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b96b9d-53e3-4d4d-ada4-a79bf9af47dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6', 'volume_size': 1, 'snapshot_id': '7548d058-97dd-4c5f-ab05-4b901a70c653'}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:17:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee315ff-9c11-4446-ab9c-3cffafa02987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:17:48 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Volume volume-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6 (6f0a7eed-f16d-42d9-8128-c3ecf3e813c6): created successfully Apr 27 10:17:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee315ff-9c11-4446-ab9c-3cffafa02987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:17:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Flow 'volume_create_manager' (35a71aa4-f0b9-4d05-928b-671537732d59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:17:48 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-adef4a34-6aaa-4479-aef3-983265340e55 tempest-SnapshotDependencyTests-1712512900 None] Created volume successfully. Apr 27 10:17:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5301f32a-7e37-4195-8fff-240cd6aa1b7e tempest-SnapshotDependencyTests-1712512900 None] Acquiring lock "cinder-7548d058-97dd-4c5f-ab05-4b901a70c653-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:17:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5301f32a-7e37-4195-8fff-240cd6aa1b7e tempest-SnapshotDependencyTests-1712512900 None] Lock "cinder-7548d058-97dd-4c5f-ab05-4b901a70c653-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:17:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5301f32a-7e37-4195-8fff-240cd6aa1b7e tempest-SnapshotDependencyTests-1712512900 None] Acquiring lock "cinder-quobyte-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:17:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5301f32a-7e37-4195-8fff-240cd6aa1b7e tempest-SnapshotDependencyTests-1712512900 None] Lock "cinder-quobyte-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:17:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5301f32a-7e37-4195-8fff-240cd6aa1b7e tempest-SnapshotDependencyTests-1712512900 None] Acquiring lock "cinder-quobyte-7548d058-97dd-4c5f-ab05-4b901a70c653" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:17:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5301f32a-7e37-4195-8fff-240cd6aa1b7e tempest-SnapshotDependencyTests-1712512900 None] Lock "cinder-quobyte-7548d058-97dd-4c5f-ab05-4b901a70c653" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:17:49 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-5301f32a-7e37-4195-8fff-240cd6aa1b7e tempest-SnapshotDependencyTests-1712512900 None] Deleting offline snapshot 7548d058-97dd-4c5f-ab05-4b901a70c653 of volume b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:17:49 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-5301f32a-7e37-4195-8fff-240cd6aa1b7e tempest-SnapshotDependencyTests-1712512900 None] snapshot_file for this snap is: volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.7548d058-97dd-4c5f-ab05-4b901a70c653 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:17:49 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0853d7b-c72b-45ed-a41d-3b2edfb8cd78]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:17:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5301f32a-7e37-4195-8fff-240cd6aa1b7e tempest-SnapshotDependencyTests-1712512900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.7548d058-97dd-4c5f-ab05-4b901a70c653 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:49 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.7548d058-97dd-4c5f-ab05-4b901a70c653 Apr 27 10:17:49 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:49 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5301f32a-7e37-4195-8fff-240cd6aa1b7e tempest-SnapshotDependencyTests-1712512900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.7548d058-97dd-4c5f-ab05-4b901a70c653" returned: 0 in 0.503s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:49 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-5301f32a-7e37-4195-8fff-240cd6aa1b7e tempest-SnapshotDependencyTests-1712512900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:17:49 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d833348-f91b-4434-bb3f-23c84f74620d]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:17:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5301f32a-7e37-4195-8fff-240cd6aa1b7e tempest-SnapshotDependencyTests-1712512900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:49 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 Apr 27 10:17:49 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:50 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5301f32a-7e37-4195-8fff-240cd6aa1b7e tempest-SnapshotDependencyTests-1712512900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8" returned: 0 in 0.500s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5301f32a-7e37-4195-8fff-240cd6aa1b7e tempest-SnapshotDependencyTests-1712512900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.7548d058-97dd-4c5f-ab05-4b901a70c653 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:50 devstack sudo[90253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.7548d058-97dd-4c5f-ab05-4b901a70c653 Apr 27 10:17:50 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:50 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5301f32a-7e37-4195-8fff-240cd6aa1b7e tempest-SnapshotDependencyTests-1712512900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.7548d058-97dd-4c5f-ab05-4b901a70c653" returned: 0 in 0.506s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5301f32a-7e37-4195-8fff-240cd6aa1b7e tempest-SnapshotDependencyTests-1712512900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.7548d058-97dd-4c5f-ab05-4b901a70c653 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:50 devstack sudo[90258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.7548d058-97dd-4c5f-ab05-4b901a70c653 Apr 27 10:17:50 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:51 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5301f32a-7e37-4195-8fff-240cd6aa1b7e tempest-SnapshotDependencyTests-1712512900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8.7548d058-97dd-4c5f-ab05-4b901a70c653" returned: 0 in 0.418s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:51 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5301f32a-7e37-4195-8fff-240cd6aa1b7e tempest-SnapshotDependencyTests-1712512900 None] Lock "cinder-quobyte-7548d058-97dd-4c5f-ab05-4b901a70c653" released by "_delete_snapshot" :: held 2.025s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:17:51 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5301f32a-7e37-4195-8fff-240cd6aa1b7e tempest-SnapshotDependencyTests-1712512900 None] Lock "cinder-quobyte-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8" released by "delete_snapshot" :: held 2.051s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:17:51 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-5301f32a-7e37-4195-8fff-240cd6aa1b7e tempest-SnapshotDependencyTests-1712512900 None] Created reservations ['258a200c-b33c-468a-9d37-5ef878ad2b45', '330785e9-21fd-4fff-acc8-c670789f71eb', 'be676d54-151e-4f61-8e92-483c790fa0bc', '2d15373a-0367-4501-9fa7-ad2c2dec7f12'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:17:51 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-5301f32a-7e37-4195-8fff-240cd6aa1b7e tempest-SnapshotDependencyTests-1712512900 None] Delete snapshot completed successfully. Apr 27 10:17:51 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5301f32a-7e37-4195-8fff-240cd6aa1b7e tempest-SnapshotDependencyTests-1712512900 None] Lock "cinder-7548d058-97dd-4c5f-ab05-4b901a70c653-delete_snapshot" released by "delete_snapshot" :: held 2.179s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:17:52 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1178aefa-bc35-4357-9786-05ed9704995c tempest-SnapshotDependencyTests-1712512900 None] Acquiring lock "cinder-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:17:52 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1178aefa-bc35-4357-9786-05ed9704995c tempest-SnapshotDependencyTests-1712512900 None] Lock "cinder-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:17:52 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1178aefa-bc35-4357-9786-05ed9704995c tempest-SnapshotDependencyTests-1712512900 None] Acquiring lock "cinder-quobyte-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:17:52 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1178aefa-bc35-4357-9786-05ed9704995c tempest-SnapshotDependencyTests-1712512900 None] Lock "cinder-quobyte-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8" acquired by "delete_volume" :: waited 0.014s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:17:52 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fade25a-1204-4302-b9ef-c6ca321cacda]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:17:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1178aefa-bc35-4357-9786-05ed9704995c tempest-SnapshotDependencyTests-1712512900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:52 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 Apr 27 10:17:52 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:52 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1178aefa-bc35-4357-9786-05ed9704995c tempest-SnapshotDependencyTests-1712512900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8" returned: 0 in 0.509s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1178aefa-bc35-4357-9786-05ed9704995c tempest-SnapshotDependencyTests-1712512900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:53 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8 Apr 27 10:17:53 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:53 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1178aefa-bc35-4357-9786-05ed9704995c tempest-SnapshotDependencyTests-1712512900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8" returned: 0 in 0.437s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:53 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1178aefa-bc35-4357-9786-05ed9704995c tempest-SnapshotDependencyTests-1712512900 None] Lock "cinder-quobyte-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8" released by "delete_volume" :: held 1.006s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:17:53 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-1178aefa-bc35-4357-9786-05ed9704995c tempest-SnapshotDependencyTests-1712512900 None] Created reservations ['feca776c-f93c-4d38-8c8a-24f0bf8941c9', '94a72daa-8a4c-4971-b0f6-d4e0d2d6e91b', 'dcdc6d60-fd85-43da-9974-87bebb230d37', '2475523f-34e1-44b4-8b53-1e497ba98a29'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:17:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1178aefa-bc35-4357-9786-05ed9704995c tempest-SnapshotDependencyTests-1712512900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:17:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1178aefa-bc35-4357-9786-05ed9704995c tempest-SnapshotDependencyTests-1712512900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:17:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-1178aefa-bc35-4357-9786-05ed9704995c tempest-SnapshotDependencyTests-1712512900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:17:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-1178aefa-bc35-4357-9786-05ed9704995c tempest-SnapshotDependencyTests-1712512900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:17:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1178aefa-bc35-4357-9786-05ed9704995c tempest-SnapshotDependencyTests-1712512900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:17:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1178aefa-bc35-4357-9786-05ed9704995c tempest-SnapshotDependencyTests-1712512900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:53 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:17:53 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:53 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1178aefa-bc35-4357-9786-05ed9704995c tempest-SnapshotDependencyTests-1712512900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.426s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:53 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-1178aefa-bc35-4357-9786-05ed9704995c tempest-SnapshotDependencyTests-1712512900 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:17:54 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-1178aefa-bc35-4357-9786-05ed9704995c tempest-SnapshotDependencyTests-1712512900 None] Deleted volume successfully. Apr 27 10:17:54 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1178aefa-bc35-4357-9786-05ed9704995c tempest-SnapshotDependencyTests-1712512900 None] Lock "cinder-b6cbbf65-e5b5-4d4d-9228-701a10d84cf8-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:17:54 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-59168f9a-634c-4fcd-acfe-bfb38fc5a571 tempest-SnapshotDependencyTests-1712512900 None] Acquiring lock "cinder-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:17:54 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-59168f9a-634c-4fcd-acfe-bfb38fc5a571 tempest-SnapshotDependencyTests-1712512900 None] Lock "cinder-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:17:54 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-59168f9a-634c-4fcd-acfe-bfb38fc5a571 tempest-SnapshotDependencyTests-1712512900 None] Acquiring lock "cinder-quobyte-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:17:54 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-59168f9a-634c-4fcd-acfe-bfb38fc5a571 tempest-SnapshotDependencyTests-1712512900 None] Lock "cinder-quobyte-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6" acquired by "delete_volume" :: waited 0.017s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:17:54 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0d20d3-309a-4b61-8e0a-63fac8689438]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:17:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-59168f9a-634c-4fcd-acfe-bfb38fc5a571 tempest-SnapshotDependencyTests-1712512900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:54 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6 Apr 27 10:17:54 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:55 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-59168f9a-634c-4fcd-acfe-bfb38fc5a571 tempest-SnapshotDependencyTests-1712512900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6" returned: 0 in 0.515s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-59168f9a-634c-4fcd-acfe-bfb38fc5a571 tempest-SnapshotDependencyTests-1712512900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:55 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6 Apr 27 10:17:55 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:55 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-59168f9a-634c-4fcd-acfe-bfb38fc5a571 tempest-SnapshotDependencyTests-1712512900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6" returned: 0 in 0.461s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:55 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-59168f9a-634c-4fcd-acfe-bfb38fc5a571 tempest-SnapshotDependencyTests-1712512900 None] Lock "cinder-quobyte-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6" released by "delete_volume" :: held 1.016s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:17:55 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-59168f9a-634c-4fcd-acfe-bfb38fc5a571 tempest-SnapshotDependencyTests-1712512900 None] Created reservations ['d1c9a696-766e-4488-9b08-8e70eda81108', '7f42512e-82f9-4893-8adf-17800708b9e8', 'f6699eec-935c-45fa-8773-859d70ce586d', '5c751cd7-009d-4886-a575-0e3b2dbd4c0f'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:17:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-59168f9a-634c-4fcd-acfe-bfb38fc5a571 tempest-SnapshotDependencyTests-1712512900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:17:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-59168f9a-634c-4fcd-acfe-bfb38fc5a571 tempest-SnapshotDependencyTests-1712512900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:17:55 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-59168f9a-634c-4fcd-acfe-bfb38fc5a571 tempest-SnapshotDependencyTests-1712512900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:17:55 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-59168f9a-634c-4fcd-acfe-bfb38fc5a571 tempest-SnapshotDependencyTests-1712512900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:17:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-59168f9a-634c-4fcd-acfe-bfb38fc5a571 tempest-SnapshotDependencyTests-1712512900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:17:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-59168f9a-634c-4fcd-acfe-bfb38fc5a571 tempest-SnapshotDependencyTests-1712512900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:17:55 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:17:55 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:17:56 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Apr 27 10:17:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-59168f9a-634c-4fcd-acfe-bfb38fc5a571 tempest-SnapshotDependencyTests-1712512900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.428s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:17:56 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-59168f9a-634c-4fcd-acfe-bfb38fc5a571 tempest-SnapshotDependencyTests-1712512900 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:17:56 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-59168f9a-634c-4fcd-acfe-bfb38fc5a571 tempest-SnapshotDependencyTests-1712512900 None] Deleted volume successfully. Apr 27 10:17:56 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-59168f9a-634c-4fcd-acfe-bfb38fc5a571 tempest-SnapshotDependencyTests-1712512900 None] Lock "cinder-6f0a7eed-f16d-42d9-8128-c3ecf3e813c6-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:05 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:UPDATE=29,cinder:SELECT=20,cinder:INSERT=7,cinder:DELETE=2 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:18:06 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:SELECT=27,cinder:INSERT=7,cinder:UPDATE=27,cinder:DELETE=3 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:18:11 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:18:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Flow 'volume_create_manager' (57b66ae0-b65b-4154-8f14-d8200a5358e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d98551e-4395-4213-9532-fe49856c8748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d98551e-4395-4213-9532-fe49856c8748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1457444908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b9b990b-228b-4169-8a3b-4dba9cfa4529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaba8ac9be1a49a7bb789b74d95823e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:12Z,use_quota=True,user_id='c7f8b6cc3e5d4679974cdba64ce8905f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6195044f-d0d6-4763-ae1e-27e3386166f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6195044f-d0d6-4763-ae1e-27e3386166f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c543fe8-779e-4df9-9356-3cae9ba1dc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c543fe8-779e-4df9-9356-3cae9ba1dc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b9b990b-228b-4169-8a3b-4dba9cfa4529', 'volume_name': 'volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94bbacd3-8600-4777-bf17-56958a0b7552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94bbacd3-8600-4777-bf17-56958a0b7552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:11 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db749a9e-cf07-47d2-b094-56e4e9da4717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:11 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Volume 1b9b990b-228b-4169-8a3b-4dba9cfa4529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529', 'volume_size': 1} Apr 27 10:18:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:11 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1457444908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b9b990b-228b-4169-8a3b-4dba9cfa4529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaba8ac9be1a49a7bb789b74d95823e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:12Z,use_quota=True,user_id='c7f8b6cc3e5d4679974cdba64ce8905f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:18:11 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Creating volume 1b9b990b-228b-4169-8a3b-4dba9cfa4529 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:18:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:11 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:11 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:11 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:18:11 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:18:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:11 devstack sudo[90364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529 1073741824 Apr 27 10:18:11 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Flow 'volume_create_manager' (7faa53bf-2e1c-4b68-82cf-2ace09090783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c350df-eae9-4a1a-afea-aef85b564a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c350df-eae9-4a1a-afea-aef85b564a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-819577232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53b7026a-5f05-4e2a-b07d-59da52285f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='958b8fcd112b4e538e321c80389b7a02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:12Z,use_quota=True,user_id='d84b90f4c6a749a18799b88589605c82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e61a90-db18-45e4-bd18-f589c4c252a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e61a90-db18-45e4-bd18-f589c4c252a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54bba03c-9031-41a8-985d-914ded220328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54bba03c-9031-41a8-985d-914ded220328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53b7026a-5f05-4e2a-b07d-59da52285f01', 'volume_name': 'volume-53b7026a-5f05-4e2a-b07d-59da52285f01', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed7ff5f-6f7e-48b0-8d99-a7ce1d9c7c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed7ff5f-6f7e-48b0-8d99-a7ce1d9c7c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f387023-adb5-489e-92a6-94c10f457155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:12 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Volume 53b7026a-5f05-4e2a-b07d-59da52285f01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53b7026a-5f05-4e2a-b07d-59da52285f01', 'volume_size': 1} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Flow 'volume_create_manager' (285fd6cd-e4ca-40ed-8277-0e2691be8df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c045e86e-7ce8-461f-88a8-7744c6e5c226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c045e86e-7ce8-461f-88a8-7744c6e5c226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-24943452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f50ee60-e7d3-4161-ab39-cd46fdf97965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6ab47545e447ff9503c5444e3f15a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:12Z,use_quota=True,user_id='e121f56b06354c25881dc3f7bb20ad24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85a75e3-1b7b-49b1-b47d-88bd44524ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85a75e3-1b7b-49b1-b47d-88bd44524ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9620105e-1ca4-4ef9-b21a-9966a501b9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9620105e-1ca4-4ef9-b21a-9966a501b9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f50ee60-e7d3-4161-ab39-cd46fdf97965', 'volume_name': 'volume-3f50ee60-e7d3-4161-ab39-cd46fdf97965', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6830f60-42e9-46f0-a2c6-96b8db5bbee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6830f60-42e9-46f0-a2c6-96b8db5bbee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68028fc8-6a58-4fd9-8f0e-79cb1bcd7219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:12 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Volume 3f50ee60-e7d3-4161-ab39-cd46fdf97965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f50ee60-e7d3-4161-ab39-cd46fdf97965', 'volume_size': 1} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Flow 'volume_create_manager' (05888efb-bca6-4eac-9062-685c5811e3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (830a3fe7-c26a-44d2-9944-8ab0d9cd787c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (830a3fe7-c26a-44d2-9944-8ab0d9cd787c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=224b4517-d29d-414d-823f-3b113d379a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64ef468334c44968fd01b1ccefdb5ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:12Z,use_quota=True,user_id='9dbc50c53a5b4062a1e9c123b7a28931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6438ed-ce46-4896-bfe1-f65afaf19093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6438ed-ce46-4896-bfe1-f65afaf19093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc538de-aa11-4fc5-a586-180362cd776b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc538de-aa11-4fc5-a586-180362cd776b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '224b4517-d29d-414d-823f-3b113d379a03', 'volume_name': 'volume-224b4517-d29d-414d-823f-3b113d379a03', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed4002d-65ab-4b37-a3d0-e7f0018896ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed4002d-65ab-4b37-a3d0-e7f0018896ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4aec70b-23fb-4ec7-940e-2d0dc5fb6bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:12 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Volume 224b4517-d29d-414d-823f-3b113d379a03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-224b4517-d29d-414d-823f-3b113d379a03', 'volume_size': 1} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Flow 'volume_create_manager' (e09baa1b-d474-4569-936a-acd90d80b18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc8aeff-f3d6-4cd0-bfc8-4817294d6515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:12 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc8aeff-f3d6-4cd0-bfc8-4817294d6515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2030470032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f28028c-6b33-4766-952f-aa431f7ae7eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6ab47545e447ff9503c5444e3f15a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:13Z,use_quota=True,user_id='e121f56b06354c25881dc3f7bb20ad24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8efb7b6a-0c2e-4cdd-9cc5-0756fa8d6c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8efb7b6a-0c2e-4cdd-9cc5-0756fa8d6c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a01078e-d596-4940-985c-cc5c063a22a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a01078e-d596-4940-985c-cc5c063a22a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f28028c-6b33-4766-952f-aa431f7ae7eb', 'volume_name': 'volume-0f28028c-6b33-4766-952f-aa431f7ae7eb', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2133324-d36d-4715-8cf2-d95c7bcf1e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2133324-d36d-4715-8cf2-d95c7bcf1e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cadfb7b-80fa-4cb3-9907-ed51571027d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:12 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Volume 0f28028c-6b33-4766-952f-aa431f7ae7eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f28028c-6b33-4766-952f-aa431f7ae7eb', 'volume_size': 1} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529 1073741824" returned: 0 in 0.815s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:12 devstack sudo[90369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529 Apr 27 10:18:12 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:12 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Flow 'volume_create_manager' (da1c04ac-2451-4562-ac42-d79f5f7353f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a5742a-ce98-4c1e-a918-ceefc5387e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a5742a-ce98-4c1e-a918-ceefc5387e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-501499459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db0e59d6-2acf-4cd5-864d-3e0a60a02d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6ab47545e447ff9503c5444e3f15a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:13Z,use_quota=True,user_id='e121f56b06354c25881dc3f7bb20ad24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608be036-ed2c-4727-a5e0-575e69ade0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608be036-ed2c-4727-a5e0-575e69ade0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c72ceb-1d83-4865-821a-dd2cba50c033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c72ceb-1d83-4865-821a-dd2cba50c033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db0e59d6-2acf-4cd5-864d-3e0a60a02d7f', 'volume_name': 'volume-db0e59d6-2acf-4cd5-864d-3e0a60a02d7f', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f636305-ec2b-43c0-9aeb-1c33351225d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f636305-ec2b-43c0-9aeb-1c33351225d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6d602f-d106-4bfb-869d-96b6d79ca531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:13 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Volume db0e59d6-2acf-4cd5-864d-3e0a60a02d7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db0e59d6-2acf-4cd5-864d-3e0a60a02d7f', 'volume_size': 1} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Flow 'volume_create_manager' (21c0f969-f4fc-4cb9-88d0-6a5dd510fceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (100e56ed-33f9-44be-a499-e6f37869742e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (100e56ed-33f9-44be-a499-e6f37869742e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1828032364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aec794d-8dbe-4907-bd39-a66b54171bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6ab47545e447ff9503c5444e3f15a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:13Z,use_quota=True,user_id='e121f56b06354c25881dc3f7bb20ad24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe4c2a1-d0d8-4fda-b978-3742e844c60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe4c2a1-d0d8-4fda-b978-3742e844c60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcccbc1e-d0d9-4bdf-a553-3e8f6c4a2ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:13 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcccbc1e-d0d9-4bdf-a553-3e8f6c4a2ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aec794d-8dbe-4907-bd39-a66b54171bb5', 'volume_name': 'volume-3aec794d-8dbe-4907-bd39-a66b54171bb5', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (770cb6f9-f410-45fa-ab63-a3ee7b00de56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (770cb6f9-f410-45fa-ab63-a3ee7b00de56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe58433-b147-4241-9092-1c0453374c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:13 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Volume 3aec794d-8dbe-4907-bd39-a66b54171bb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aec794d-8dbe-4907-bd39-a66b54171bb5', 'volume_size': 1} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529" returned: 0 in 0.591s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.306s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-819577232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53b7026a-5f05-4e2a-b07d-59da52285f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='958b8fcd112b4e538e321c80389b7a02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:12Z,use_quota=True,user_id='d84b90f4c6a749a18799b88589605c82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Creating volume 53b7026a-5f05-4e2a-b07d-59da52285f01 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:18:13 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db749a9e-cf07-47d2-b094-56e4e9da4717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ca353b-199d-4d56-bb98-0804cd9bf404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:13 devstack sudo[90372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01 1073741824 Apr 27 10:18:13 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:13 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Volume volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529 (1b9b990b-228b-4169-8a3b-4dba9cfa4529): created successfully Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ca353b-199d-4d56-bb98-0804cd9bf404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Flow 'volume_create_manager' (57b66ae0-b65b-4154-8f14-d8200a5358e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:13 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-8070aabe-d17b-4b0f-aa1d-7a5b1a581552 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Created volume successfully. Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Flow 'volume_create_manager' (fc0e97f1-8614-4410-a880-2bb215abbc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bdf903-de31-4f98-b304-165522b28c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bdf903-de31-4f98-b304-165522b28c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-806784196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b167d33-325a-4967-bfd4-a2ffe3ff8056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6ab47545e447ff9503c5444e3f15a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:14Z,use_quota=True,user_id='e121f56b06354c25881dc3f7bb20ad24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (996127d2-9b98-42c8-b66f-ebb70b66da1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (996127d2-9b98-42c8-b66f-ebb70b66da1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3def414b-66b0-4db0-aeb0-dc1f1eab8748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3def414b-66b0-4db0-aeb0-dc1f1eab8748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b167d33-325a-4967-bfd4-a2ffe3ff8056', 'volume_name': 'volume-1b167d33-325a-4967-bfd4-a2ffe3ff8056', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d817865a-46e0-4796-862f-458f7059e4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d817865a-46e0-4796-862f-458f7059e4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f468b8-9348-447c-9f7d-4f21dc82d7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:13 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Volume 1b167d33-325a-4967-bfd4-a2ffe3ff8056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b167d33-325a-4967-bfd4-a2ffe3ff8056', 'volume_size': 1} Apr 27 10:18:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:14 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01 1073741824" returned: 0 in 0.647s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:14 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01 Apr 27 10:18:14 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:14 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01" returned: 0 in 0.481s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:18:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.134s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-24943452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f50ee60-e7d3-4161-ab39-cd46fdf97965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6ab47545e447ff9503c5444e3f15a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:12Z,use_quota=True,user_id='e121f56b06354c25881dc3f7bb20ad24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:18:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Creating volume 3f50ee60-e7d3-4161-ab39-cd46fdf97965 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:18:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:14 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:18:14 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:18:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3f50ee60-e7d3-4161-ab39-cd46fdf97965 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:14 devstack sudo[90380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3f50ee60-e7d3-4161-ab39-cd46fdf97965 1073741824 Apr 27 10:18:14 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:14 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f387023-adb5-489e-92a6-94c10f457155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53b7026a-5f05-4e2a-b07d-59da52285f01', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:14 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b29811e-09f4-4cf5-89a1-e4f1dc9d021d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:14 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Volume volume-53b7026a-5f05-4e2a-b07d-59da52285f01 (53b7026a-5f05-4e2a-b07d-59da52285f01): created successfully Apr 27 10:18:14 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b29811e-09f4-4cf5-89a1-e4f1dc9d021d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:14 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Flow 'volume_create_manager' (7faa53bf-2e1c-4b68-82cf-2ace09090783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:14 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-ec68b314-e8dc-4289-8c1b-3d524d3e488d tempest-VolumeDependencyTests-731872209 None] Created volume successfully. Apr 27 10:18:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-6afc9ac1-d046-4d66-a097-ca4d3d9818db tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:15 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3f50ee60-e7d3-4161-ab39-cd46fdf97965 1073741824" returned: 0 in 0.617s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3f50ee60-e7d3-4161-ab39-cd46fdf97965 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:15 devstack sudo[90392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3f50ee60-e7d3-4161-ab39-cd46fdf97965 Apr 27 10:18:15 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-9456af33-c5d4-4483-86cc-51591e33ec2e tempest-VolumeDependencyTests-731872209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:15 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3f50ee60-e7d3-4161-ab39-cd46fdf97965" returned: 0 in 0.493s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:15 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:18:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.164s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:15 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=224b4517-d29d-414d-823f-3b113d379a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64ef468334c44968fd01b1ccefdb5ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:12Z,use_quota=True,user_id='9dbc50c53a5b4062a1e9c123b7a28931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:18:15 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Creating volume 224b4517-d29d-414d-823f-3b113d379a03 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:18:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:15 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:15 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:15 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:18:15 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:18:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-224b4517-d29d-414d-823f-3b113d379a03 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:15 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-224b4517-d29d-414d-823f-3b113d379a03 1073741824 Apr 27 10:18:15 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:15 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68028fc8-6a58-4fd9-8f0e-79cb1bcd7219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f50ee60-e7d3-4161-ab39-cd46fdf97965', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:15 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5da0d8b-bbfc-46ba-a5d3-10ad838583fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:15 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Volume volume-3f50ee60-e7d3-4161-ab39-cd46fdf97965 (3f50ee60-e7d3-4161-ab39-cd46fdf97965): created successfully Apr 27 10:18:15 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5da0d8b-bbfc-46ba-a5d3-10ad838583fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:15 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Flow 'volume_create_manager' (285fd6cd-e4ca-40ed-8277-0e2691be8df1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:15 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-66603a1b-44a7-4e11-a565-bf30fb0895a0 tempest-CreateVolumesFromImageTest-276850991 None] Created volume successfully. Apr 27 10:18:16 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-224b4517-d29d-414d-823f-3b113d379a03 1073741824" returned: 0 in 0.631s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-224b4517-d29d-414d-823f-3b113d379a03 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:16 devstack sudo[90400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-224b4517-d29d-414d-823f-3b113d379a03 Apr 27 10:18:16 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG oslo_service.periodic_task [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81350) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:16 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:18:16 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:16 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-224b4517-d29d-414d-823f-3b113d379a03" returned: 0 in 0.478s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.113s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2030470032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f28028c-6b33-4766-952f-aa431f7ae7eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6ab47545e447ff9503c5444e3f15a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:13Z,use_quota=True,user_id='e121f56b06354c25881dc3f7bb20ad24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Creating volume 0f28028c-6b33-4766-952f-aa431f7ae7eb {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:18:16 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f28028c-6b33-4766-952f-aa431f7ae7eb 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:16 devstack sudo[90405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f28028c-6b33-4766-952f-aa431f7ae7eb 1073741824 Apr 27 10:18:16 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4aec70b-23fb-4ec7-940e-2d0dc5fb6bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-224b4517-d29d-414d-823f-3b113d379a03', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91cb526c-67e6-47e4-b384-b6ea7527e846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:16 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Volume volume-224b4517-d29d-414d-823f-3b113d379a03 (224b4517-d29d-414d-823f-3b113d379a03): created successfully Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91cb526c-67e6-47e4-b384-b6ea7527e846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:16 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Flow 'volume_create_manager' (05888efb-bca6-4eac-9062-685c5811e3b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:16 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-1e0b8556-69df-407f-916f-8592c1579841 tempest-CinderUnicodeTest-290536026 None] Created volume successfully. Apr 27 10:18:17 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.477s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:17 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:18:17 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f28028c-6b33-4766-952f-aa431f7ae7eb 1073741824" returned: 0 in 0.624s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f28028c-6b33-4766-952f-aa431f7ae7eb {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:17 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f28028c-6b33-4766-952f-aa431f7ae7eb Apr 27 10:18:17 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:18 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f28028c-6b33-4766-952f-aa431f7ae7eb" returned: 0 in 0.496s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.967s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-501499459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db0e59d6-2acf-4cd5-864d-3e0a60a02d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6ab47545e447ff9503c5444e3f15a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:13Z,use_quota=True,user_id='e121f56b06354c25881dc3f7bb20ad24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Creating volume db0e59d6-2acf-4cd5-864d-3e0a60a02d7f {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:18:18 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-db0e59d6-2acf-4cd5-864d-3e0a60a02d7f 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cadfb7b-80fa-4cb3-9907-ed51571027d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f28028c-6b33-4766-952f-aa431f7ae7eb', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50187a75-926a-49a1-abe4-7a18f74cb63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:18 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-db0e59d6-2acf-4cd5-864d-3e0a60a02d7f 1073741824 Apr 27 10:18:18 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:18 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Volume volume-0f28028c-6b33-4766-952f-aa431f7ae7eb (0f28028c-6b33-4766-952f-aa431f7ae7eb): created successfully Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50187a75-926a-49a1-abe4-7a18f74cb63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Flow 'volume_create_manager' (e09baa1b-d474-4569-936a-acd90d80b18f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:18 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-a5343929-8d6a-4811-94b0-8bdb9bd46d18 tempest-CreateVolumesFromImageTest-276850991 None] Created volume successfully. Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Flow 'volume_create_manager' (671376ab-d8d7-43cb-b43a-ec350e626039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69196f8b-9a60-4fdd-8be7-a51577cebfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69196f8b-9a60-4fdd-8be7-a51577cebfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-896721323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78bd5508-1b8c-486c-8af0-41f79db3f737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64ef468334c44968fd01b1ccefdb5ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:18Z,use_quota=True,user_id='9dbc50c53a5b4062a1e9c123b7a28931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ea2335c-08ed-4075-8b09-97e675b4bb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ea2335c-08ed-4075-8b09-97e675b4bb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a021885d-e67c-4c85-b4f1-063cc12ec56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a021885d-e67c-4c85-b4f1-063cc12ec56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78bd5508-1b8c-486c-8af0-41f79db3f737', 'volume_name': 'volume-78bd5508-1b8c-486c-8af0-41f79db3f737', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba141999-a0bf-45c7-bb1b-4361e2e784ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba141999-a0bf-45c7-bb1b-4361e2e784ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd6ce1d-86e5-43aa-aec8-49c7e9ff8a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:18 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Volume 78bd5508-1b8c-486c-8af0-41f79db3f737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78bd5508-1b8c-486c-8af0-41f79db3f737', 'volume_size': 1} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:18 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-db0e59d6-2acf-4cd5-864d-3e0a60a02d7f 1073741824" returned: 0 in 0.641s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-db0e59d6-2acf-4cd5-864d-3e0a60a02d7f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:18 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-db0e59d6-2acf-4cd5-864d-3e0a60a02d7f Apr 27 10:18:18 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:19 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-db0e59d6-2acf-4cd5-864d-3e0a60a02d7f" returned: 0 in 0.500s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:19 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:18:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.852s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:19 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1828032364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aec794d-8dbe-4907-bd39-a66b54171bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6ab47545e447ff9503c5444e3f15a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:13Z,use_quota=True,user_id='e121f56b06354c25881dc3f7bb20ad24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:18:19 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Creating volume 3aec794d-8dbe-4907-bd39-a66b54171bb5 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:18:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:19 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:19 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:19 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:18:19 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:18:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3aec794d-8dbe-4907-bd39-a66b54171bb5 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:19 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6d602f-d106-4bfb-869d-96b6d79ca531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db0e59d6-2acf-4cd5-864d-3e0a60a02d7f', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:19 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3aec794d-8dbe-4907-bd39-a66b54171bb5 1073741824 Apr 27 10:18:19 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:19 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (658257b9-0a70-426e-a1f2-37764e45121b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:19 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Volume volume-db0e59d6-2acf-4cd5-864d-3e0a60a02d7f (db0e59d6-2acf-4cd5-864d-3e0a60a02d7f): created successfully Apr 27 10:18:19 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (658257b9-0a70-426e-a1f2-37764e45121b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:19 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Flow 'volume_create_manager' (da1c04ac-2451-4562-ac42-d79f5f7353f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:19 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-5ec64838-b68e-4fde-8850-3fac5d4f16bb tempest-CreateVolumesFromImageTest-276850991 None] Created volume successfully. Apr 27 10:18:19 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3aec794d-8dbe-4907-bd39-a66b54171bb5 1073741824" returned: 0 in 0.642s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3aec794d-8dbe-4907-bd39-a66b54171bb5 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:19 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3aec794d-8dbe-4907-bd39-a66b54171bb5 Apr 27 10:18:19 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:20 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3aec794d-8dbe-4907-bd39-a66b54171bb5" returned: 0 in 0.448s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:20 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:18:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.749s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:20 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-806784196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b167d33-325a-4967-bfd4-a2ffe3ff8056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6ab47545e447ff9503c5444e3f15a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:14Z,use_quota=True,user_id='e121f56b06354c25881dc3f7bb20ad24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:18:20 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Creating volume 1b167d33-325a-4967-bfd4-a2ffe3ff8056 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:18:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:20 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:20 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:20 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:18:20 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:18:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b167d33-325a-4967-bfd4-a2ffe3ff8056 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:20 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe58433-b147-4241-9092-1c0453374c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aec794d-8dbe-4907-bd39-a66b54171bb5', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:20 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62cba5f-a846-4c3e-a799-22068d439fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:20 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b167d33-325a-4967-bfd4-a2ffe3ff8056 1073741824 Apr 27 10:18:20 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:20 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Volume volume-3aec794d-8dbe-4907-bd39-a66b54171bb5 (3aec794d-8dbe-4907-bd39-a66b54171bb5): created successfully Apr 27 10:18:20 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62cba5f-a846-4c3e-a799-22068d439fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:20 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Flow 'volume_create_manager' (21c0f969-f4fc-4cb9-88d0-6a5dd510fceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:20 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-780343a0-b981-4cca-ab20-1eb3298f5d2d tempest-CreateVolumesFromImageTest-276850991 None] Created volume successfully. Apr 27 10:18:20 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b167d33-325a-4967-bfd4-a2ffe3ff8056 1073741824" returned: 0 in 0.590s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b167d33-325a-4967-bfd4-a2ffe3ff8056 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:21 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b167d33-325a-4967-bfd4-a2ffe3ff8056 Apr 27 10:18:21 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:21 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b167d33-325a-4967-bfd4-a2ffe3ff8056" returned: 0 in 0.439s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:21 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:18:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-6afc9ac1-d046-4d66-a097-ca4d3d9818db tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.734s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f468b8-9348-447c-9f7d-4f21dc82d7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b167d33-325a-4967-bfd4-a2ffe3ff8056', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e12687-c2a9-47a4-b17b-63980b47606b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:21 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-6afc9ac1-d046-4d66-a097-ca4d3d9818db tempest-CreateVolumesFromSnapshotTest-1571585239 None] Creating offline snapshot 6632eee0-d06e-441b-a9c4-231b2b830f2f of volume 1b9b990b-228b-4169-8a3b-4dba9cfa4529 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:18:21 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Volume volume-1b167d33-325a-4967-bfd4-a2ffe3ff8056 (1b167d33-325a-4967-bfd4-a2ffe3ff8056): created successfully Apr 27 10:18:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e12687-c2a9-47a4-b17b-63980b47606b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:21 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Flow 'volume_create_manager' (fc0e97f1-8614-4410-a880-2bb215abbc2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:21 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9883376e-51f0-4fc2-ad5d-85ec57dba6d1]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6afc9ac1-d046-4d66-a097-ca4d3d9818db tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:21 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-7837a707-6aa9-41d6-9c33-8eef78da4415 tempest-CreateVolumesFromImageTest-276850991 None] Created volume successfully. Apr 27 10:18:21 devstack sudo[90439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529 Apr 27 10:18:21 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:22 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6afc9ac1-d046-4d66-a097-ca4d3d9818db tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529" returned: 0 in 0.519s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6afc9ac1-d046-4d66-a097-ca4d3d9818db tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.6632eee0-d06e-441b-a9c4-231b2b830f2f 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:22 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.6632eee0-d06e-441b-a9c4-231b2b830f2f 1G Apr 27 10:18:22 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:22 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-829ed653-c1ff-4ff2-b00f-6f3d82ca981d tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "cinder-1b167d33-325a-4967-bfd4-a2ffe3ff8056-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:22 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-829ed653-c1ff-4ff2-b00f-6f3d82ca981d tempest-CreateVolumesFromImageTest-276850991 None] Lock "cinder-1b167d33-325a-4967-bfd4-a2ffe3ff8056-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:22 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-829ed653-c1ff-4ff2-b00f-6f3d82ca981d tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "cinder-quobyte-1b167d33-325a-4967-bfd4-a2ffe3ff8056" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:22 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-829ed653-c1ff-4ff2-b00f-6f3d82ca981d tempest-CreateVolumesFromImageTest-276850991 None] Lock "cinder-quobyte-1b167d33-325a-4967-bfd4-a2ffe3ff8056" acquired by "delete_volume" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:22 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bd6bf2-2d9d-40ab-afdc-82f5a29f270d]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-829ed653-c1ff-4ff2-b00f-6f3d82ca981d tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b167d33-325a-4967-bfd4-a2ffe3ff8056 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:22 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b167d33-325a-4967-bfd4-a2ffe3ff8056 Apr 27 10:18:22 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:22 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6afc9ac1-d046-4d66-a097-ca4d3d9818db tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.6632eee0-d06e-441b-a9c4-231b2b830f2f 1G" returned: 0 in 0.625s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6afc9ac1-d046-4d66-a097-ca4d3d9818db tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.6632eee0-d06e-441b-a9c4-231b2b830f2f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:22 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.6632eee0-d06e-441b-a9c4-231b2b830f2f Apr 27 10:18:22 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:22 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-829ed653-c1ff-4ff2-b00f-6f3d82ca981d tempest-CreateVolumesFromImageTest-276850991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b167d33-325a-4967-bfd4-a2ffe3ff8056" returned: 0 in 0.562s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-829ed653-c1ff-4ff2-b00f-6f3d82ca981d tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b167d33-325a-4967-bfd4-a2ffe3ff8056 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:23 devstack sudo[90456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b167d33-325a-4967-bfd4-a2ffe3ff8056 Apr 27 10:18:23 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:23 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6afc9ac1-d046-4d66-a097-ca4d3d9818db tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.6632eee0-d06e-441b-a9c4-231b2b830f2f" returned: 0 in 0.504s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:23 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-6afc9ac1-d046-4d66-a097-ca4d3d9818db tempest-CreateVolumesFromSnapshotTest-1571585239 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.6632eee0-d06e-441b-a9c4-231b2b830f2f is being set with open permissions: ugo+rw Apr 27 10:18:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6afc9ac1-d046-4d66-a097-ca4d3d9818db tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.6632eee0-d06e-441b-a9c4-231b2b830f2f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:23 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.6632eee0-d06e-441b-a9c4-231b2b830f2f Apr 27 10:18:23 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:23 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-829ed653-c1ff-4ff2-b00f-6f3d82ca981d tempest-CreateVolumesFromImageTest-276850991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b167d33-325a-4967-bfd4-a2ffe3ff8056" returned: 0 in 0.474s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:23 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-829ed653-c1ff-4ff2-b00f-6f3d82ca981d tempest-CreateVolumesFromImageTest-276850991 None] Lock "cinder-quobyte-1b167d33-325a-4967-bfd4-a2ffe3ff8056" released by "delete_volume" :: held 1.077s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:23 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-829ed653-c1ff-4ff2-b00f-6f3d82ca981d tempest-CreateVolumesFromImageTest-276850991 None] Created reservations ['a8754143-c533-4a3f-a5b2-0dd92e54432e', '671dbdd7-6867-42a1-b6df-c16428dfe682', 'f05e4aba-f2aa-4f24-815a-9b0fd9122907', 'dec53d7a-eb3e-4657-a6c2-d417810f25dd'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:18:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-829ed653-c1ff-4ff2-b00f-6f3d82ca981d tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-829ed653-c1ff-4ff2-b00f-6f3d82ca981d tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:23 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-829ed653-c1ff-4ff2-b00f-6f3d82ca981d tempest-CreateVolumesFromImageTest-276850991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:23 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-829ed653-c1ff-4ff2-b00f-6f3d82ca981d tempest-CreateVolumesFromImageTest-276850991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-829ed653-c1ff-4ff2-b00f-6f3d82ca981d tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-829ed653-c1ff-4ff2-b00f-6f3d82ca981d tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:23 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:18:23 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:23 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6afc9ac1-d046-4d66-a097-ca4d3d9818db tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.6632eee0-d06e-441b-a9c4-231b2b830f2f" returned: 0 in 0.488s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6afc9ac1-d046-4d66-a097-ca4d3d9818db tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:23 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.info Apr 27 10:18:23 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:24 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-829ed653-c1ff-4ff2-b00f-6f3d82ca981d tempest-CreateVolumesFromImageTest-276850991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.468s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:24 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-829ed653-c1ff-4ff2-b00f-6f3d82ca981d tempest-CreateVolumesFromImageTest-276850991 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:18:24 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-829ed653-c1ff-4ff2-b00f-6f3d82ca981d tempest-CreateVolumesFromImageTest-276850991 None] Deleted volume successfully. Apr 27 10:18:24 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-829ed653-c1ff-4ff2-b00f-6f3d82ca981d tempest-CreateVolumesFromImageTest-276850991 None] Lock "cinder-1b167d33-325a-4967-bfd4-a2ffe3ff8056-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:24 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6afc9ac1-d046-4d66-a097-ca4d3d9818db tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.info" returned: 0 in 0.465s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:24 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-6afc9ac1-d046-4d66-a097-ca4d3d9818db tempest-CreateVolumesFromSnapshotTest-1571585239 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.info is being set with open permissions: ugo+rw Apr 27 10:18:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6afc9ac1-d046-4d66-a097-ca4d3d9818db tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:24 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.info Apr 27 10:18:24 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:24 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bf6bade8-efa2-4689-a680-0df709f8acec tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "cinder-3aec794d-8dbe-4907-bd39-a66b54171bb5-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:24 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bf6bade8-efa2-4689-a680-0df709f8acec tempest-CreateVolumesFromImageTest-276850991 None] Lock "cinder-3aec794d-8dbe-4907-bd39-a66b54171bb5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:24 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bf6bade8-efa2-4689-a680-0df709f8acec tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "cinder-quobyte-3aec794d-8dbe-4907-bd39-a66b54171bb5" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:24 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6afc9ac1-d046-4d66-a097-ca4d3d9818db tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.info" returned: 0 in 0.476s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-6afc9ac1-d046-4d66-a097-ca4d3d9818db tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.188s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:24 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bf6bade8-efa2-4689-a680-0df709f8acec tempest-CreateVolumesFromImageTest-276850991 None] Lock "cinder-quobyte-3aec794d-8dbe-4907-bd39-a66b54171bb5" acquired by "delete_volume" :: waited 0.039s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-9456af33-c5d4-4483-86cc-51591e33ec2e tempest-VolumeDependencyTests-731872209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.957s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:24 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff969229-1bb9-4beb-a53e-2c16e64396cb]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bf6bade8-efa2-4689-a680-0df709f8acec tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3aec794d-8dbe-4907-bd39-a66b54171bb5 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:24 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-9456af33-c5d4-4483-86cc-51591e33ec2e tempest-VolumeDependencyTests-731872209 None] Creating offline snapshot 33e06052-4108-42f4-8fbb-2c4b1debef31 of volume 53b7026a-5f05-4e2a-b07d-59da52285f01 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:18:24 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-6afc9ac1-d046-4d66-a097-ca4d3d9818db tempest-CreateVolumesFromSnapshotTest-1571585239 None] Create snapshot completed successfully Apr 27 10:18:24 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5813c537-8087-41a2-a9f7-60822006e7de]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9456af33-c5d4-4483-86cc-51591e33ec2e tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:24 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3aec794d-8dbe-4907-bd39-a66b54171bb5 Apr 27 10:18:24 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:24 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01 Apr 27 10:18:24 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:25 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bf6bade8-efa2-4689-a680-0df709f8acec tempest-CreateVolumesFromImageTest-276850991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3aec794d-8dbe-4907-bd39-a66b54171bb5" returned: 0 in 0.563s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bf6bade8-efa2-4689-a680-0df709f8acec tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3aec794d-8dbe-4907-bd39-a66b54171bb5 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:25 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3aec794d-8dbe-4907-bd39-a66b54171bb5 Apr 27 10:18:25 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:25 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9456af33-c5d4-4483-86cc-51591e33ec2e tempest-VolumeDependencyTests-731872209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01" returned: 0 in 0.603s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9456af33-c5d4-4483-86cc-51591e33ec2e tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.33e06052-4108-42f4-8fbb-2c4b1debef31 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:25 devstack sudo[90487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.33e06052-4108-42f4-8fbb-2c4b1debef31 1G Apr 27 10:18:25 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Flow 'volume_create_manager' (f41f94d5-8221-4eba-b89b-9b6c3923b05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f85cf77-53b0-4f04-a512-564abf783f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f85cf77-53b0-4f04-a512-564abf783f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1664711596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d23859-8812-4e50-80e6-5782353e6edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaba8ac9be1a49a7bb789b74d95823e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:25Z,use_quota=True,user_id='c7f8b6cc3e5d4679974cdba64ce8905f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08d4258-ef0f-4b20-8be2-a637975f7c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08d4258-ef0f-4b20-8be2-a637975f7c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (665d71a9-6bff-44e6-8de7-a7157339a4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (665d71a9-6bff-44e6-8de7-a7157339a4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2d23859-8812-4e50-80e6-5782353e6edb', 'volume_name': 'volume-d2d23859-8812-4e50-80e6-5782353e6edb', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e14947-51bc-48bc-a79e-606e16b0fedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e14947-51bc-48bc-a79e-606e16b0fedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05210cca-1de4-4c72-8d7b-be191e72c05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:25 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Volume d2d23859-8812-4e50-80e6-5782353e6edb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2d23859-8812-4e50-80e6-5782353e6edb', 'volume_size': 1} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Flow 'volume_create_manager' (8126b6f5-f321-423f-9a0b-f8bb74192bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0024cf0e-75a3-446a-a8cf-558339ddb3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0024cf0e-75a3-446a-a8cf-558339ddb3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-748078884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=426ab364-47ed-4f29-806b-ca511bac5cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaba8ac9be1a49a7bb789b74d95823e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:26Z,use_quota=True,user_id='c7f8b6cc3e5d4679974cdba64ce8905f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae45932-cc32-42f0-b99c-a50a9017cd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae45932-cc32-42f0-b99c-a50a9017cd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb9bbe2-b3cf-4725-b45f-3d6e76d07b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb9bbe2-b3cf-4725-b45f-3d6e76d07b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '426ab364-47ed-4f29-806b-ca511bac5cdf', 'volume_name': 'volume-426ab364-47ed-4f29-806b-ca511bac5cdf', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:25 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88fc59b8-25f0-4076-ab52-6087cf5a7902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88fc59b8-25f0-4076-ab52-6087cf5a7902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7025125b-f7dc-4073-b83c-f0486150a6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:25 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Volume 426ab364-47ed-4f29-806b-ca511bac5cdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-426ab364-47ed-4f29-806b-ca511bac5cdf', 'volume_size': 1} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bf6bade8-efa2-4689-a680-0df709f8acec tempest-CreateVolumesFromImageTest-276850991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3aec794d-8dbe-4907-bd39-a66b54171bb5" returned: 0 in 0.563s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bf6bade8-efa2-4689-a680-0df709f8acec tempest-CreateVolumesFromImageTest-276850991 None] Lock "cinder-quobyte-3aec794d-8dbe-4907-bd39-a66b54171bb5" released by "delete_volume" :: held 1.178s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:25 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-bf6bade8-efa2-4689-a680-0df709f8acec tempest-CreateVolumesFromImageTest-276850991 None] Created reservations ['a64b5a19-15d1-441b-b04e-acd5c1c57537', '8fe2e864-31c6-4206-a5a1-e3cb92ad525f', 'df0d7605-e309-48f4-ab40-a44a41a778ad', 'a0d17b1e-b5fe-49f9-8d30-0b32d403bc85'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bf6bade8-efa2-4689-a680-0df709f8acec tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bf6bade8-efa2-4689-a680-0df709f8acec tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-bf6bade8-efa2-4689-a680-0df709f8acec tempest-CreateVolumesFromImageTest-276850991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-bf6bade8-efa2-4689-a680-0df709f8acec tempest-CreateVolumesFromImageTest-276850991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bf6bade8-efa2-4689-a680-0df709f8acec tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bf6bade8-efa2-4689-a680-0df709f8acec tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:26 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:18:26 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:26 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Flow 'volume_create_manager' (2f8d42db-d2a4-4e6a-a933-29cd9572d7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184a3d07-77d1-40b0-9bd5-0bd7b210fbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9456af33-c5d4-4483-86cc-51591e33ec2e tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.33e06052-4108-42f4-8fbb-2c4b1debef31 1G" returned: 0 in 0.864s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9456af33-c5d4-4483-86cc-51591e33ec2e tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53b7026a-5f05-4e2a-b07d-59da52285f01 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.33e06052-4108-42f4-8fbb-2c4b1debef31 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184a3d07-77d1-40b0-9bd5-0bd7b210fbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-288047243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f4d82b-4440-485f-b2cc-f7ceb011bec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaba8ac9be1a49a7bb789b74d95823e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:26Z,use_quota=True,user_id='c7f8b6cc3e5d4679974cdba64ce8905f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a039c0-4be7-4493-81ce-9d531b9c7403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:26 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53b7026a-5f05-4e2a-b07d-59da52285f01 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.33e06052-4108-42f4-8fbb-2c4b1debef31 Apr 27 10:18:26 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a039c0-4be7-4493-81ce-9d531b9c7403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb321691-c632-4376-b168-cedf0dc5139b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb321691-c632-4376-b168-cedf0dc5139b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06f4d82b-4440-485f-b2cc-f7ceb011bec1', 'volume_name': 'volume-06f4d82b-4440-485f-b2cc-f7ceb011bec1', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0ec0315-7920-4f8b-87aa-e7a49c484d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0ec0315-7920-4f8b-87aa-e7a49c484d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6f1e70a-a6a4-4673-83ff-da12f6d572d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:26 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Volume 06f4d82b-4440-485f-b2cc-f7ceb011bec1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06f4d82b-4440-485f-b2cc-f7ceb011bec1', 'volume_size': 1} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Flow 'volume_create_manager' (e6d96148-2f94-4486-9519-5d2d98cbbf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e119331-8e52-4188-96b2-5f236c39f761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e119331-8e52-4188-96b2-5f236c39f761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1240298687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a23fe50f-d9c1-4500-aac7-bb59875d879a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaba8ac9be1a49a7bb789b74d95823e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:26Z,use_quota=True,user_id='c7f8b6cc3e5d4679974cdba64ce8905f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f74960-1296-4c5b-8c54-a4df85b1cbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f74960-1296-4c5b-8c54-a4df85b1cbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f40f1d5-78fe-459a-9345-a4af6bca7b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f40f1d5-78fe-459a-9345-a4af6bca7b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a23fe50f-d9c1-4500-aac7-bb59875d879a', 'volume_name': 'volume-a23fe50f-d9c1-4500-aac7-bb59875d879a', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f53ba0b4-9b13-4b78-b4df-833724ffe18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f53ba0b4-9b13-4b78-b4df-833724ffe18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aedd287-a1b6-4c60-9130-70ec1ad51a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:26 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Volume a23fe50f-d9c1-4500-aac7-bb59875d879a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a23fe50f-d9c1-4500-aac7-bb59875d879a', 'volume_size': 1} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:26 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bf6bade8-efa2-4689-a680-0df709f8acec tempest-CreateVolumesFromImageTest-276850991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.594s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-bf6bade8-efa2-4689-a680-0df709f8acec tempest-CreateVolumesFromImageTest-276850991 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Flow 'volume_create_manager' (86c1fb17-428b-480c-b7d3-e0c1b48153de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f95c7b6-855a-4d0f-83f2-b42956294633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:26 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-bf6bade8-efa2-4689-a680-0df709f8acec tempest-CreateVolumesFromImageTest-276850991 None] Deleted volume successfully. Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f95c7b6-855a-4d0f-83f2-b42956294633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-143179867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1258bb0a-41cb-4e6d-bfa6-40245acf92b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaba8ac9be1a49a7bb789b74d95823e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:27Z,use_quota=True,user_id='c7f8b6cc3e5d4679974cdba64ce8905f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc90345-6346-4d50-9dc0-ff5ecc5d8040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc90345-6346-4d50-9dc0-ff5ecc5d8040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff74bb9-371a-4eaa-a877-3d3bf7e37fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff74bb9-371a-4eaa-a877-3d3bf7e37fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1258bb0a-41cb-4e6d-bfa6-40245acf92b2', 'volume_name': 'volume-1258bb0a-41cb-4e6d-bfa6-40245acf92b2', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33d84cd-a65c-49ce-a66e-0c8ee419a010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33d84cd-a65c-49ce-a66e-0c8ee419a010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f87e908-761e-431a-8dfe-210c6331d7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:26 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Volume 1258bb0a-41cb-4e6d-bfa6-40245acf92b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1258bb0a-41cb-4e6d-bfa6-40245acf92b2', 'volume_size': 1} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bf6bade8-efa2-4689-a680-0df709f8acec tempest-CreateVolumesFromImageTest-276850991 None] Lock "cinder-3aec794d-8dbe-4907-bd39-a66b54171bb5-delete_volume" released by "delete_volume" :: held 2.156s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-52cf4138-8dc4-4dfa-a604-681c1bf2501c tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "cinder-db0e59d6-2acf-4cd5-864d-3e0a60a02d7f-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-52cf4138-8dc4-4dfa-a604-681c1bf2501c tempest-CreateVolumesFromImageTest-276850991 None] Lock "cinder-db0e59d6-2acf-4cd5-864d-3e0a60a02d7f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:26 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-52cf4138-8dc4-4dfa-a604-681c1bf2501c tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "cinder-quobyte-db0e59d6-2acf-4cd5-864d-3e0a60a02d7f" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9456af33-c5d4-4483-86cc-51591e33ec2e tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53b7026a-5f05-4e2a-b07d-59da52285f01 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.33e06052-4108-42f4-8fbb-2c4b1debef31" returned: 0 in 0.674s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:26 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-9456af33-c5d4-4483-86cc-51591e33ec2e tempest-VolumeDependencyTests-731872209 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.33e06052-4108-42f4-8fbb-2c4b1debef31 is being set with open permissions: ugo+rw Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9456af33-c5d4-4483-86cc-51591e33ec2e tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.33e06052-4108-42f4-8fbb-2c4b1debef31 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-52cf4138-8dc4-4dfa-a604-681c1bf2501c tempest-CreateVolumesFromImageTest-276850991 None] Lock "cinder-quobyte-db0e59d6-2acf-4cd5-864d-3e0a60a02d7f" acquired by "delete_volume" :: waited 0.026s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:26 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.33e06052-4108-42f4-8fbb-2c4b1debef31 Apr 27 10:18:26 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d36de40-fe01-4779-901e-742902191bef]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-52cf4138-8dc4-4dfa-a604-681c1bf2501c tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-db0e59d6-2acf-4cd5-864d-3e0a60a02d7f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:26 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-db0e59d6-2acf-4cd5-864d-3e0a60a02d7f Apr 27 10:18:26 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:27 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9456af33-c5d4-4483-86cc-51591e33ec2e tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.33e06052-4108-42f4-8fbb-2c4b1debef31" returned: 0 in 0.431s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9456af33-c5d4-4483-86cc-51591e33ec2e tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:27 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.info Apr 27 10:18:27 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:27 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-52cf4138-8dc4-4dfa-a604-681c1bf2501c tempest-CreateVolumesFromImageTest-276850991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-db0e59d6-2acf-4cd5-864d-3e0a60a02d7f" returned: 0 in 0.533s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-52cf4138-8dc4-4dfa-a604-681c1bf2501c tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-db0e59d6-2acf-4cd5-864d-3e0a60a02d7f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:27 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-db0e59d6-2acf-4cd5-864d-3e0a60a02d7f Apr 27 10:18:27 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:27 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9456af33-c5d4-4483-86cc-51591e33ec2e tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.info" returned: 0 in 0.464s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:27 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-9456af33-c5d4-4483-86cc-51591e33ec2e tempest-VolumeDependencyTests-731872209 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.info is being set with open permissions: ugo+rw Apr 27 10:18:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9456af33-c5d4-4483-86cc-51591e33ec2e tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:27 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.info Apr 27 10:18:27 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:27 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-52cf4138-8dc4-4dfa-a604-681c1bf2501c tempest-CreateVolumesFromImageTest-276850991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-db0e59d6-2acf-4cd5-864d-3e0a60a02d7f" returned: 0 in 0.479s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:27 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-52cf4138-8dc4-4dfa-a604-681c1bf2501c tempest-CreateVolumesFromImageTest-276850991 None] Lock "cinder-quobyte-db0e59d6-2acf-4cd5-864d-3e0a60a02d7f" released by "delete_volume" :: held 1.050s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:27 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-52cf4138-8dc4-4dfa-a604-681c1bf2501c tempest-CreateVolumesFromImageTest-276850991 None] Created reservations ['0a70085a-1c71-44b0-9ca5-c5938f0927da', '2c6f52d2-cc4b-4005-bf07-9f5fc6a8a9d0', '848c6160-15fe-4b61-8142-1bdcd2dd0e7f', 'e347838c-7aa5-41cb-bb3a-58fb9f30b464'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:18:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-52cf4138-8dc4-4dfa-a604-681c1bf2501c tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-52cf4138-8dc4-4dfa-a604-681c1bf2501c tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:28 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-52cf4138-8dc4-4dfa-a604-681c1bf2501c tempest-CreateVolumesFromImageTest-276850991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:28 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-52cf4138-8dc4-4dfa-a604-681c1bf2501c tempest-CreateVolumesFromImageTest-276850991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-52cf4138-8dc4-4dfa-a604-681c1bf2501c tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-52cf4138-8dc4-4dfa-a604-681c1bf2501c tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:28 devstack sudo[90517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:18:28 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:28 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9456af33-c5d4-4483-86cc-51591e33ec2e tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.info" returned: 0 in 0.476s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-9456af33-c5d4-4483-86cc-51591e33ec2e tempest-VolumeDependencyTests-731872209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.622s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.998s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:28 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-896721323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78bd5508-1b8c-486c-8af0-41f79db3f737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64ef468334c44968fd01b1ccefdb5ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:18Z,use_quota=True,user_id='9dbc50c53a5b4062a1e9c123b7a28931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:18:28 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Creating volume 78bd5508-1b8c-486c-8af0-41f79db3f737 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:18:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:28 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:28 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:28 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:18:28 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:18:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:28 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737 1073741824 Apr 27 10:18:28 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:28 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-9456af33-c5d4-4483-86cc-51591e33ec2e tempest-VolumeDependencyTests-731872209 None] Create snapshot completed successfully Apr 27 10:18:28 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-52cf4138-8dc4-4dfa-a604-681c1bf2501c tempest-CreateVolumesFromImageTest-276850991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.441s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:28 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-52cf4138-8dc4-4dfa-a604-681c1bf2501c tempest-CreateVolumesFromImageTest-276850991 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:18:28 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-52cf4138-8dc4-4dfa-a604-681c1bf2501c tempest-CreateVolumesFromImageTest-276850991 None] Deleted volume successfully. Apr 27 10:18:28 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-52cf4138-8dc4-4dfa-a604-681c1bf2501c tempest-CreateVolumesFromImageTest-276850991 None] Lock "cinder-db0e59d6-2acf-4cd5-864d-3e0a60a02d7f-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:28 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737 1073741824" returned: 0 in 0.609s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:28 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:28 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737 Apr 27 10:18:28 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-f57a8e1d-b22e-48f4-a9fe-16e10905114f tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "cinder-0f28028c-6b33-4766-952f-aa431f7ae7eb-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-f57a8e1d-b22e-48f4-a9fe-16e10905114f tempest-CreateVolumesFromImageTest-276850991 None] Lock "cinder-0f28028c-6b33-4766-952f-aa431f7ae7eb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-f57a8e1d-b22e-48f4-a9fe-16e10905114f tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "cinder-quobyte-0f28028c-6b33-4766-952f-aa431f7ae7eb" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-f57a8e1d-b22e-48f4-a9fe-16e10905114f tempest-CreateVolumesFromImageTest-276850991 None] Lock "cinder-quobyte-0f28028c-6b33-4766-952f-aa431f7ae7eb" acquired by "delete_volume" :: waited 0.012s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0439a4-ba11-47e1-8c22-4de450b05d9a]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f57a8e1d-b22e-48f4-a9fe-16e10905114f tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f28028c-6b33-4766-952f-aa431f7ae7eb {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:29 devstack sudo[90528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f28028c-6b33-4766-952f-aa431f7ae7eb Apr 27 10:18:29 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:29 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737" returned: 0 in 0.464s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.896s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1664711596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d23859-8812-4e50-80e6-5782353e6edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaba8ac9be1a49a7bb789b74d95823e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:25Z,use_quota=True,user_id='c7f8b6cc3e5d4679974cdba64ce8905f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Creating volume d2d23859-8812-4e50-80e6-5782353e6edb {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:18:29 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2d23859-8812-4e50-80e6-5782353e6edb 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:29 devstack sudo[90531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2d23859-8812-4e50-80e6-5782353e6edb 1073741824 Apr 27 10:18:29 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd6ce1d-86e5-43aa-aec8-49c7e9ff8a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78bd5508-1b8c-486c-8af0-41f79db3f737', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c293090c-61dd-436a-873c-5bf08814aef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:29 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Volume volume-78bd5508-1b8c-486c-8af0-41f79db3f737 (78bd5508-1b8c-486c-8af0-41f79db3f737): created successfully Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c293090c-61dd-436a-873c-5bf08814aef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Flow 'volume_create_manager' (671376ab-d8d7-43cb-b43a-ec350e626039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:29 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-9eb94613-4189-4688-b35d-e03c779d9229 tempest-CinderUnicodeTest-290536026 None] Created volume successfully. Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Flow 'volume_create_manager' (97cd8454-4ee0-4672-86e1-3c5a097edbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3458b8f-833c-4cdd-b6f8-85b157ffe5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3458b8f-833c-4cdd-b6f8-85b157ffe5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1910232859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f1933d1-4640-4b5f-a06a-a05254e58fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='958b8fcd112b4e538e321c80389b7a02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=33e06052-4108-42f4-8fbb-2c4b1debef31,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:30Z,use_quota=True,user_id='d84b90f4c6a749a18799b88589605c82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9e7b21-dc9d-48bc-a19e-5ddf1befea8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9e7b21-dc9d-48bc-a19e-5ddf1befea8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a6b9ff-5e97-4ee5-926c-8e0a7ec8b57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a6b9ff-5e97-4ee5-926c-8e0a7ec8b57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0f1933d1-4640-4b5f-a06a-a05254e58fb1', 'volume_name': 'volume-0f1933d1-4640-4b5f-a06a-a05254e58fb1', 'volume_size': 1, 'snapshot_id': '33e06052-4108-42f4-8fbb-2c4b1debef31'}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614d92d4-77fa-4d1d-a27c-febdc6783f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614d92d4-77fa-4d1d-a27c-febdc6783f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd84edf5-bca1-489b-af0a-756ed849576c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:29 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Volume 0f1933d1-4640-4b5f-a06a-a05254e58fb1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0f1933d1-4640-4b5f-a06a-a05254e58fb1', 'volume_size': 1, 'snapshot_id': '33e06052-4108-42f4-8fbb-2c4b1debef31'} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:29 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f57a8e1d-b22e-48f4-a9fe-16e10905114f tempest-CreateVolumesFromImageTest-276850991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f28028c-6b33-4766-952f-aa431f7ae7eb" returned: 0 in 0.603s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:29 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f57a8e1d-b22e-48f4-a9fe-16e10905114f tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f28028c-6b33-4766-952f-aa431f7ae7eb {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:29 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f28028c-6b33-4766-952f-aa431f7ae7eb Apr 27 10:18:29 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:30 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2d23859-8812-4e50-80e6-5782353e6edb 1073741824" returned: 0 in 0.769s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2df8c444-0965-4b24-9398-2d51bab28f6c tempest-CinderUnicodeTest-290536026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2d23859-8812-4e50-80e6-5782353e6edb {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:30 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2d23859-8812-4e50-80e6-5782353e6edb Apr 27 10:18:30 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:30 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f57a8e1d-b22e-48f4-a9fe-16e10905114f tempest-CreateVolumesFromImageTest-276850991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f28028c-6b33-4766-952f-aa431f7ae7eb" returned: 0 in 0.543s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-f57a8e1d-b22e-48f4-a9fe-16e10905114f tempest-CreateVolumesFromImageTest-276850991 None] Lock "cinder-quobyte-0f28028c-6b33-4766-952f-aa431f7ae7eb" released by "delete_volume" :: held 1.195s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-f57a8e1d-b22e-48f4-a9fe-16e10905114f tempest-CreateVolumesFromImageTest-276850991 None] Created reservations ['ff40abe2-134b-4a77-8813-da5892c20f3c', '23748c65-945e-47b9-8723-46d76e5744d0', '93393356-144d-4d66-8e8b-81d361f2ef3b', '88fed3c1-4e00-451d-8f50-fb271f71302f'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f57a8e1d-b22e-48f4-a9fe-16e10905114f tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f57a8e1d-b22e-48f4-a9fe-16e10905114f tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f57a8e1d-b22e-48f4-a9fe-16e10905114f tempest-CreateVolumesFromImageTest-276850991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f57a8e1d-b22e-48f4-a9fe-16e10905114f tempest-CreateVolumesFromImageTest-276850991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f57a8e1d-b22e-48f4-a9fe-16e10905114f tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f57a8e1d-b22e-48f4-a9fe-16e10905114f tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:30 devstack sudo[90545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:18:30 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:30 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2d23859-8812-4e50-80e6-5782353e6edb" returned: 0 in 0.453s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.881s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-748078884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=426ab364-47ed-4f29-806b-ca511bac5cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaba8ac9be1a49a7bb789b74d95823e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:26Z,use_quota=True,user_id='c7f8b6cc3e5d4679974cdba64ce8905f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Creating volume 426ab364-47ed-4f29-806b-ca511bac5cdf {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:18:30 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-426ab364-47ed-4f29-806b-ca511bac5cdf 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:30 devstack sudo[90548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-426ab364-47ed-4f29-806b-ca511bac5cdf 1073741824 Apr 27 10:18:30 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05210cca-1de4-4c72-8d7b-be191e72c05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2d23859-8812-4e50-80e6-5782353e6edb', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f89988a-29a4-4b79-8a5c-cd8dd78ffc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:30 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Volume volume-d2d23859-8812-4e50-80e6-5782353e6edb (d2d23859-8812-4e50-80e6-5782353e6edb): created successfully Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f89988a-29a4-4b79-8a5c-cd8dd78ffc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Flow 'volume_create_manager' (f41f94d5-8221-4eba-b89b-9b6c3923b05d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:30 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-53097f63-2c2b-44fb-a376-ab32be010648 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Created volume successfully. Apr 27 10:18:30 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f57a8e1d-b22e-48f4-a9fe-16e10905114f tempest-CreateVolumesFromImageTest-276850991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.472s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-f57a8e1d-b22e-48f4-a9fe-16e10905114f tempest-CreateVolumesFromImageTest-276850991 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:18:30 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-f57a8e1d-b22e-48f4-a9fe-16e10905114f tempest-CreateVolumesFromImageTest-276850991 None] Deleted volume successfully. Apr 27 10:18:30 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-f57a8e1d-b22e-48f4-a9fe-16e10905114f tempest-CreateVolumesFromImageTest-276850991 None] Lock "cinder-0f28028c-6b33-4766-952f-aa431f7ae7eb-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3cf4491c-d687-4e43-b6e1-22d157691ff7 tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "cinder-3f50ee60-e7d3-4161-ab39-cd46fdf97965-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3cf4491c-d687-4e43-b6e1-22d157691ff7 tempest-CreateVolumesFromImageTest-276850991 None] Lock "cinder-3f50ee60-e7d3-4161-ab39-cd46fdf97965-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3cf4491c-d687-4e43-b6e1-22d157691ff7 tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "cinder-quobyte-3f50ee60-e7d3-4161-ab39-cd46fdf97965" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3cf4491c-d687-4e43-b6e1-22d157691ff7 tempest-CreateVolumesFromImageTest-276850991 None] Lock "cinder-quobyte-3f50ee60-e7d3-4161-ab39-cd46fdf97965" acquired by "delete_volume" :: waited 0.020s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71e278c-2087-4a7c-bfc7-eccfb4bb0bcf]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3cf4491c-d687-4e43-b6e1-22d157691ff7 tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3f50ee60-e7d3-4161-ab39-cd46fdf97965 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:31 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-426ab364-47ed-4f29-806b-ca511bac5cdf 1073741824" returned: 0 in 0.691s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-426ab364-47ed-4f29-806b-ca511bac5cdf {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:31 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-426ab364-47ed-4f29-806b-ca511bac5cdf Apr 27 10:18:31 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:31 devstack sudo[90556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3f50ee60-e7d3-4161-ab39-cd46fdf97965 Apr 27 10:18:31 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:31 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-426ab364-47ed-4f29-806b-ca511bac5cdf" returned: 0 in 0.466s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.619s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-288047243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f4d82b-4440-485f-b2cc-f7ceb011bec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaba8ac9be1a49a7bb789b74d95823e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:26Z,use_quota=True,user_id='c7f8b6cc3e5d4679974cdba64ce8905f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Creating volume 06f4d82b-4440-485f-b2cc-f7ceb011bec1 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:18:31 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06f4d82b-4440-485f-b2cc-f7ceb011bec1 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:31 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7025125b-f7dc-4073-b83c-f0486150a6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-426ab364-47ed-4f29-806b-ca511bac5cdf', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7cd858a-296f-4d6f-bb2a-a26068e6ff1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:31 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06f4d82b-4440-485f-b2cc-f7ceb011bec1 1073741824 Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3cf4491c-d687-4e43-b6e1-22d157691ff7 tempest-CreateVolumesFromImageTest-276850991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3f50ee60-e7d3-4161-ab39-cd46fdf97965" returned: 0 in 0.564s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:31 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3cf4491c-d687-4e43-b6e1-22d157691ff7 tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3f50ee60-e7d3-4161-ab39-cd46fdf97965 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:31 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Volume volume-426ab364-47ed-4f29-806b-ca511bac5cdf (426ab364-47ed-4f29-806b-ca511bac5cdf): created successfully Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7cd858a-296f-4d6f-bb2a-a26068e6ff1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:31 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Flow 'volume_create_manager' (8126b6f5-f321-423f-9a0b-f8bb74192bd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:31 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3f50ee60-e7d3-4161-ab39-cd46fdf97965 Apr 27 10:18:31 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:31 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-12665139-e52a-4368-9913-6b6dc84271d2 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Created volume successfully. Apr 27 10:18:32 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3cf4491c-d687-4e43-b6e1-22d157691ff7 tempest-CreateVolumesFromImageTest-276850991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-3f50ee60-e7d3-4161-ab39-cd46fdf97965" returned: 0 in 0.497s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:32 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3cf4491c-d687-4e43-b6e1-22d157691ff7 tempest-CreateVolumesFromImageTest-276850991 None] Lock "cinder-quobyte-3f50ee60-e7d3-4161-ab39-cd46fdf97965" released by "delete_volume" :: held 1.101s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:32 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-3cf4491c-d687-4e43-b6e1-22d157691ff7 tempest-CreateVolumesFromImageTest-276850991 None] Created reservations ['56487ea0-73cc-4e10-9666-5fe60ea79c33', '347cbf0a-738a-4766-b8e2-cb20782b5d20', '799525b8-d7a9-4f87-ad56-87a61e12b61b', '9f415139-2b7f-4d08-b707-138cecddf679'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:18:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3cf4491c-d687-4e43-b6e1-22d157691ff7 tempest-CreateVolumesFromImageTest-276850991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3cf4491c-d687-4e43-b6e1-22d157691ff7 tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3cf4491c-d687-4e43-b6e1-22d157691ff7 tempest-CreateVolumesFromImageTest-276850991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:32 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3cf4491c-d687-4e43-b6e1-22d157691ff7 tempest-CreateVolumesFromImageTest-276850991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3cf4491c-d687-4e43-b6e1-22d157691ff7 tempest-CreateVolumesFromImageTest-276850991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3cf4491c-d687-4e43-b6e1-22d157691ff7 tempest-CreateVolumesFromImageTest-276850991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:32 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:18:32 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:32 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06f4d82b-4440-485f-b2cc-f7ceb011bec1 1073741824" returned: 0 in 0.699s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06f4d82b-4440-485f-b2cc-f7ceb011bec1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:32 devstack sudo[90574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06f4d82b-4440-485f-b2cc-f7ceb011bec1 Apr 27 10:18:32 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:33 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3cf4491c-d687-4e43-b6e1-22d157691ff7 tempest-CreateVolumesFromImageTest-276850991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.460s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:33 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-3cf4491c-d687-4e43-b6e1-22d157691ff7 tempest-CreateVolumesFromImageTest-276850991 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:18:33 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-3cf4491c-d687-4e43-b6e1-22d157691ff7 tempest-CreateVolumesFromImageTest-276850991 None] Deleted volume successfully. Apr 27 10:18:33 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3cf4491c-d687-4e43-b6e1-22d157691ff7 tempest-CreateVolumesFromImageTest-276850991 None] Lock "cinder-3f50ee60-e7d3-4161-ab39-cd46fdf97965-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:33 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06f4d82b-4440-485f-b2cc-f7ceb011bec1" returned: 0 in 0.454s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:33 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:18:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.658s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:33 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1240298687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a23fe50f-d9c1-4500-aac7-bb59875d879a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaba8ac9be1a49a7bb789b74d95823e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:26Z,use_quota=True,user_id='c7f8b6cc3e5d4679974cdba64ce8905f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:18:33 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Creating volume a23fe50f-d9c1-4500-aac7-bb59875d879a {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:18:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:33 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:33 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:33 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:18:33 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:18:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a23fe50f-d9c1-4500-aac7-bb59875d879a 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6f1e70a-a6a4-4673-83ff-da12f6d572d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06f4d82b-4440-485f-b2cc-f7ceb011bec1', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:33 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a23fe50f-d9c1-4500-aac7-bb59875d879a 1073741824 Apr 27 10:18:33 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5989c615-991a-45b8-9721-4b5df74017dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:33 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Volume volume-06f4d82b-4440-485f-b2cc-f7ceb011bec1 (06f4d82b-4440-485f-b2cc-f7ceb011bec1): created successfully Apr 27 10:18:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5989c615-991a-45b8-9721-4b5df74017dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Flow 'volume_create_manager' (2f8d42db-d2a4-4e6a-a933-29cd9572d7c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:33 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-0b290358-0520-4af7-bc55-c149e10d5dda tempest-CreateVolumesFromSnapshotTest-1571585239 None] Created volume successfully. Apr 27 10:18:33 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a23fe50f-d9c1-4500-aac7-bb59875d879a 1073741824" returned: 0 in 0.629s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a23fe50f-d9c1-4500-aac7-bb59875d879a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:33 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a23fe50f-d9c1-4500-aac7-bb59875d879a Apr 27 10:18:33 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:34 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a23fe50f-d9c1-4500-aac7-bb59875d879a" returned: 0 in 0.507s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:18:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.540s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-143179867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1258bb0a-41cb-4e6d-bfa6-40245acf92b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaba8ac9be1a49a7bb789b74d95823e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:27Z,use_quota=True,user_id='c7f8b6cc3e5d4679974cdba64ce8905f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:18:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Creating volume 1258bb0a-41cb-4e6d-bfa6-40245acf92b2 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:18:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:18:34 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:18:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1258bb0a-41cb-4e6d-bfa6-40245acf92b2 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aedd287-a1b6-4c60-9130-70ec1ad51a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a23fe50f-d9c1-4500-aac7-bb59875d879a', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:34 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1258bb0a-41cb-4e6d-bfa6-40245acf92b2 1073741824 Apr 27 10:18:34 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc164c1-e156-4d8a-a6a1-47bad144c04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:34 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Volume volume-a23fe50f-d9c1-4500-aac7-bb59875d879a (a23fe50f-d9c1-4500-aac7-bb59875d879a): created successfully Apr 27 10:18:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc164c1-e156-4d8a-a6a1-47bad144c04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:34 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Flow 'volume_create_manager' (e6d96148-2f94-4486-9519-5d2d98cbbf2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:34 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-f4602211-1337-4d4f-852e-a2606b7f164d tempest-CreateVolumesFromSnapshotTest-1571585239 None] Created volume successfully. Apr 27 10:18:34 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1258bb0a-41cb-4e6d-bfa6-40245acf92b2 1073741824" returned: 0 in 0.686s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1258bb0a-41cb-4e6d-bfa6-40245acf92b2 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:35 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1258bb0a-41cb-4e6d-bfa6-40245acf92b2 Apr 27 10:18:35 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:35 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1258bb0a-41cb-4e6d-bfa6-40245acf92b2" returned: 0 in 0.495s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.825s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Acquiring lock "cinder-quobyte-33e06052-4108-42f4-8fbb-2c4b1debef31-0f1933d1-4640-4b5f-a06a-a05254e58fb1" by "_create_volume_from_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f87e908-761e-431a-8dfe-210c6331d7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1258bb0a-41cb-4e6d-bfa6-40245acf92b2', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b42bfc3-dc90-4231-b15e-d836d0a8ed9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Lock "cinder-quobyte-33e06052-4108-42f4-8fbb-2c4b1debef31-0f1933d1-4640-4b5f-a06a-a05254e58fb1" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Creating volume 0f1933d1-4640-4b5f-a06a-a05254e58fb1 from snapshot 33e06052-4108-42f4-8fbb-2c4b1debef31 {{(pid=81350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Acquiring lock "cinder-quobyte-0f1933d1-4640-4b5f-a06a-a05254e58fb1" by "_copy_volume_from_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:35 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Volume volume-1258bb0a-41cb-4e6d-bfa6-40245acf92b2 (1258bb0a-41cb-4e6d-bfa6-40245acf92b2): created successfully Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b42bfc3-dc90-4231-b15e-d836d0a8ed9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Flow 'volume_create_manager' (86c1fb17-428b-480c-b7d3-e0c1b48153de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Lock "cinder-quobyte-0f1933d1-4640-4b5f-a06a-a05254e58fb1" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] snapshot: 33e06052-4108-42f4-8fbb-2c4b1debef31, volume: 0f1933d1-4640-4b5f-a06a-a05254e58fb1, {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 27 10:18:35 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-039ad3e4-38aa-4191-adb4-ec9b1e21b4b6 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Created volume successfully. Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[263a87dd-dc99-465c-8844-3475030d5bd9]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.33e06052-4108-42f4-8fbb-2c4b1debef31 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:35 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.33e06052-4108-42f4-8fbb-2c4b1debef31 Apr 27 10:18:35 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Flow 'volume_create_manager' (7a0341de-3f52-4725-b8a6-73e76a5d316d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c27aef9-2c0e-4b3b-b075-b0ad4cf00af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c27aef9-2c0e-4b3b-b075-b0ad4cf00af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1617343264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ae8210-befd-45da-9ab9-ca922664b06a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e9f05089fa4202b801bb8d71bdce80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:36Z,use_quota=True,user_id='b401138a80c14f87a07dfa920c8ad7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd85220-894f-4339-b46a-ab7959e2f2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd85220-894f-4339-b46a-ab7959e2f2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e45357-5a70-4653-9b61-3b94224c322a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e45357-5a70-4653-9b61-3b94224c322a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57ae8210-befd-45da-9ab9-ca922664b06a', 'volume_name': 'volume-57ae8210-befd-45da-9ab9-ca922664b06a', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (379409db-3ceb-4749-9801-180ada47a04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (379409db-3ceb-4749-9801-180ada47a04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c239b7b-0b76-41e5-9ca7-24d832a84c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:36 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Volume 57ae8210-befd-45da-9ab9-ca922664b06a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57ae8210-befd-45da-9ab9-ca922664b06a', 'volume_size': 1} Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:36 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.33e06052-4108-42f4-8fbb-2c4b1debef31" returned: 0 in 0.558s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53b7026a-5f05-4e2a-b07d-59da52285f01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01 {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Creating direct copy from snapshot {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[63041e33-e992-4bbd-8574-a2724ad3d73b]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:36 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01 Apr 27 10:18:36 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-60804e10-b55d-43a3-9b23-759d5a818a48 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "cinder-1258bb0a-41cb-4e6d-bfa6-40245acf92b2-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-60804e10-b55d-43a3-9b23-759d5a818a48 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-1258bb0a-41cb-4e6d-bfa6-40245acf92b2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-60804e10-b55d-43a3-9b23-759d5a818a48 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "cinder-quobyte-1258bb0a-41cb-4e6d-bfa6-40245acf92b2" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-60804e10-b55d-43a3-9b23-759d5a818a48 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-quobyte-1258bb0a-41cb-4e6d-bfa6-40245acf92b2" acquired by "delete_volume" :: waited 0.024s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe36320-a0f3-4c5d-b46f-0bd36c043edf]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-60804e10-b55d-43a3-9b23-759d5a818a48 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1258bb0a-41cb-4e6d-bfa6-40245acf92b2 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:36 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1258bb0a-41cb-4e6d-bfa6-40245acf92b2 Apr 27 10:18:36 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:36 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01" returned: 0 in 0.581s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG cinder.utils [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Path /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f1933d1-4640-4b5f-a06a-a05254e58fb1 not found in is_blk_device check {{(pid=81350) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 27 10:18:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f1933d1-4640-4b5f-a06a-a05254e58fb1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:36 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f1933d1-4640-4b5f-a06a-a05254e58fb1 Apr 27 10:18:36 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:37 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-60804e10-b55d-43a3-9b23-759d5a818a48 tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1258bb0a-41cb-4e6d-bfa6-40245acf92b2" returned: 0 in 0.540s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-60804e10-b55d-43a3-9b23-759d5a818a48 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1258bb0a-41cb-4e6d-bfa6-40245acf92b2 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:37 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1258bb0a-41cb-4e6d-bfa6-40245acf92b2 Apr 27 10:18:37 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:38 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-60804e10-b55d-43a3-9b23-759d5a818a48 tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1258bb0a-41cb-4e6d-bfa6-40245acf92b2" returned: 0 in 0.860s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:38 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-60804e10-b55d-43a3-9b23-759d5a818a48 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-quobyte-1258bb0a-41cb-4e6d-bfa6-40245acf92b2" released by "delete_volume" :: held 1.462s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:38 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-60804e10-b55d-43a3-9b23-759d5a818a48 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Created reservations ['0800fb72-9e66-4d89-9578-0c8d3043c9f7', '9b240a71-ad54-461e-9224-d6e64a93fc3b', 'aab65e40-eec7-4ef6-8916-da220eaa6f45', '644f70f6-af25-4a6d-8624-899c57ed2aea'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:18:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-60804e10-b55d-43a3-9b23-759d5a818a48 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-60804e10-b55d-43a3-9b23-759d5a818a48 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:38 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-60804e10-b55d-43a3-9b23-759d5a818a48 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:38 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-60804e10-b55d-43a3-9b23-759d5a818a48 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-60804e10-b55d-43a3-9b23-759d5a818a48 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-60804e10-b55d-43a3-9b23-759d5a818a48 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:38 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:18:38 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:38 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-26fa9934-b31d-4495-bf43-52ff9304d5dc tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "cinder-a23fe50f-d9c1-4500-aac7-bb59875d879a-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:38 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-26fa9934-b31d-4495-bf43-52ff9304d5dc tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-a23fe50f-d9c1-4500-aac7-bb59875d879a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-26fa9934-b31d-4495-bf43-52ff9304d5dc tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "cinder-quobyte-a23fe50f-d9c1-4500-aac7-bb59875d879a" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-26fa9934-b31d-4495-bf43-52ff9304d5dc tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-quobyte-a23fe50f-d9c1-4500-aac7-bb59875d879a" acquired by "delete_volume" :: waited 0.052s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:39 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb71d9d7-cacb-40d1-8f61-6cdd0c50d319]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-26fa9934-b31d-4495-bf43-52ff9304d5dc tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a23fe50f-d9c1-4500-aac7-bb59875d879a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:39 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a23fe50f-d9c1-4500-aac7-bb59875d879a Apr 27 10:18:39 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:39 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-60804e10-b55d-43a3-9b23-759d5a818a48 tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 1.017s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:39 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-60804e10-b55d-43a3-9b23-759d5a818a48 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:18:39 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-60804e10-b55d-43a3-9b23-759d5a818a48 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Deleted volume successfully. Apr 27 10:18:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-60804e10-b55d-43a3-9b23-759d5a818a48 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-1258bb0a-41cb-4e6d-bfa6-40245acf92b2-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:40 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-26fa9934-b31d-4495-bf43-52ff9304d5dc tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a23fe50f-d9c1-4500-aac7-bb59875d879a" returned: 0 in 1.024s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-26fa9934-b31d-4495-bf43-52ff9304d5dc tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a23fe50f-d9c1-4500-aac7-bb59875d879a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:40 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a23fe50f-d9c1-4500-aac7-bb59875d879a Apr 27 10:18:40 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:41 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-26fa9934-b31d-4495-bf43-52ff9304d5dc tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a23fe50f-d9c1-4500-aac7-bb59875d879a" returned: 0 in 1.098s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:41 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-26fa9934-b31d-4495-bf43-52ff9304d5dc tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-quobyte-a23fe50f-d9c1-4500-aac7-bb59875d879a" released by "delete_volume" :: held 2.240s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:41 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-26fa9934-b31d-4495-bf43-52ff9304d5dc tempest-CreateVolumesFromSnapshotTest-1571585239 None] Created reservations ['7f32e766-bb3a-472d-b286-7bda7237737a', 'ad200218-a242-40a4-945b-ffaa57bde344', '60fdb44e-9361-4819-9cef-d45603634f48', '825ea8e2-49db-4f48-b814-411c2ccf639e'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:18:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-26fa9934-b31d-4495-bf43-52ff9304d5dc tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-26fa9934-b31d-4495-bf43-52ff9304d5dc tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-26fa9934-b31d-4495-bf43-52ff9304d5dc tempest-CreateVolumesFromSnapshotTest-1571585239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:41 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-26fa9934-b31d-4495-bf43-52ff9304d5dc tempest-CreateVolumesFromSnapshotTest-1571585239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-26fa9934-b31d-4495-bf43-52ff9304d5dc tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-26fa9934-b31d-4495-bf43-52ff9304d5dc tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:41 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:18:41 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:42 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f1933d1-4640-4b5f-a06a-a05254e58fb1" returned: 0 in 5.222s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:42 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cf870e-67d7-4fb0-9f5c-015c79acfc15]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:42 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01 Apr 27 10:18:42 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:42 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-26fa9934-b31d-4495-bf43-52ff9304d5dc tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.645s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:42 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-26fa9934-b31d-4495-bf43-52ff9304d5dc tempest-CreateVolumesFromSnapshotTest-1571585239 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:18:42 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-26fa9934-b31d-4495-bf43-52ff9304d5dc tempest-CreateVolumesFromSnapshotTest-1571585239 None] Deleted volume successfully. Apr 27 10:18:42 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-26fa9934-b31d-4495-bf43-52ff9304d5dc tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-a23fe50f-d9c1-4500-aac7-bb59875d879a-delete_volume" released by "delete_volume" :: held 3.365s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:42 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fdd05842-37cb-4f3a-b821-00e0ebb96c5b tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "cinder-06f4d82b-4440-485f-b2cc-f7ceb011bec1-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:42 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fdd05842-37cb-4f3a-b821-00e0ebb96c5b tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-06f4d82b-4440-485f-b2cc-f7ceb011bec1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:42 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fdd05842-37cb-4f3a-b821-00e0ebb96c5b tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "cinder-quobyte-06f4d82b-4440-485f-b2cc-f7ceb011bec1" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:42 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fdd05842-37cb-4f3a-b821-00e0ebb96c5b tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-quobyte-06f4d82b-4440-485f-b2cc-f7ceb011bec1" acquired by "delete_volume" :: waited 0.020s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:42 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb6cbfb-d5ec-459e-8b25-213d3f781f20]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fdd05842-37cb-4f3a-b821-00e0ebb96c5b tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06f4d82b-4440-485f-b2cc-f7ceb011bec1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:42 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06f4d82b-4440-485f-b2cc-f7ceb011bec1 Apr 27 10:18:42 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:42 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01" returned: 0 in 0.715s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:42 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Image conversion details: src /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01, size 1024.00 MB, duration 5.22 sec, destination /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f1933d1-4640-4b5f-a06a-a05254e58fb1 {{(pid=81350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 10:18:42 devstack cinder-volume[81350]: INFO cinder.image.image_utils [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Converted 1024.00 MB image at 195.98 MB/s Apr 27 10:18:42 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f1933d1-4640-4b5f-a06a-a05254e58fb1 is being set with open permissions: ugo+rw Apr 27 10:18:42 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f1933d1-4640-4b5f-a06a-a05254e58fb1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:42 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f1933d1-4640-4b5f-a06a-a05254e58fb1 Apr 27 10:18:42 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:43 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fdd05842-37cb-4f3a-b821-00e0ebb96c5b tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06f4d82b-4440-485f-b2cc-f7ceb011bec1" returned: 0 in 0.540s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fdd05842-37cb-4f3a-b821-00e0ebb96c5b tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06f4d82b-4440-485f-b2cc-f7ceb011bec1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:43 devstack sudo[90651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06f4d82b-4440-485f-b2cc-f7ceb011bec1 Apr 27 10:18:43 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:43 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f1933d1-4640-4b5f-a06a-a05254e58fb1" returned: 0 in 0.452s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Lock "cinder-quobyte-0f1933d1-4640-4b5f-a06a-a05254e58fb1" released by "_copy_volume_from_snapshot" :: held 7.636s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Lock "cinder-quobyte-33e06052-4108-42f4-8fbb-2c4b1debef31-0f1933d1-4640-4b5f-a06a-a05254e58fb1" released by "_create_volume_from_snapshot" :: held 7.680s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.724s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2df8c444-0965-4b24-9398-2d51bab28f6c tempest-CinderUnicodeTest-290536026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.032s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-2df8c444-0965-4b24-9398-2d51bab28f6c tempest-CinderUnicodeTest-290536026 None] Creating offline snapshot ca30a852-903f-43f7-a6de-94ee92696ea7 of volume 78bd5508-1b8c-486c-8af0-41f79db3f737 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd84edf5-bca1-489b-af0a-756ed849576c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f1933d1-4640-4b5f-a06a-a05254e58fb1', 'volume_size': 1, 'snapshot_id': '33e06052-4108-42f4-8fbb-2c4b1debef31'}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e84f1d4-3874-4200-b971-2577e1804aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3700e59a-7ae2-46ee-ab0e-177373ac934a]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2df8c444-0965-4b24-9398-2d51bab28f6c tempest-CinderUnicodeTest-290536026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:43 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Volume volume-0f1933d1-4640-4b5f-a06a-a05254e58fb1 (0f1933d1-4640-4b5f-a06a-a05254e58fb1): created successfully Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e84f1d4-3874-4200-b971-2577e1804aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Flow 'volume_create_manager' (97cd8454-4ee0-4672-86e1-3c5a097edbf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:43 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-375a8dcf-2073-4f4d-9791-6f718ef96ebd tempest-VolumeDependencyTests-731872209 None] Created volume successfully. Apr 27 10:18:43 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737 Apr 27 10:18:43 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:43 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fdd05842-37cb-4f3a-b821-00e0ebb96c5b tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-06f4d82b-4440-485f-b2cc-f7ceb011bec1" returned: 0 in 0.462s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fdd05842-37cb-4f3a-b821-00e0ebb96c5b tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-quobyte-06f4d82b-4440-485f-b2cc-f7ceb011bec1" released by "delete_volume" :: held 1.058s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-fdd05842-37cb-4f3a-b821-00e0ebb96c5b tempest-CreateVolumesFromSnapshotTest-1571585239 None] Created reservations ['9c0317f1-dd6d-49eb-bc63-e84b348f69e1', '2303deb4-ba07-4a9c-98bd-94a160727e2e', '26989c59-67d4-46c4-80f9-6384718779e3', 'edff2d14-c8c1-40f4-b2b7-e5c1cce17ed2'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-fdd05842-37cb-4f3a-b821-00e0ebb96c5b tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-fdd05842-37cb-4f3a-b821-00e0ebb96c5b tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-fdd05842-37cb-4f3a-b821-00e0ebb96c5b tempest-CreateVolumesFromSnapshotTest-1571585239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-fdd05842-37cb-4f3a-b821-00e0ebb96c5b tempest-CreateVolumesFromSnapshotTest-1571585239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-fdd05842-37cb-4f3a-b821-00e0ebb96c5b tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fdd05842-37cb-4f3a-b821-00e0ebb96c5b tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:43 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:18:43 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b536e67c-e0d9-489c-9202-74ee400959b4 tempest-VolumeDependencyTests-731872209 None] Acquiring lock "cinder-33e06052-4108-42f4-8fbb-2c4b1debef31-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b536e67c-e0d9-489c-9202-74ee400959b4 tempest-VolumeDependencyTests-731872209 None] Lock "cinder-33e06052-4108-42f4-8fbb-2c4b1debef31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b536e67c-e0d9-489c-9202-74ee400959b4 tempest-VolumeDependencyTests-731872209 None] Acquiring lock "cinder-quobyte-53b7026a-5f05-4e2a-b07d-59da52285f01" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b536e67c-e0d9-489c-9202-74ee400959b4 tempest-VolumeDependencyTests-731872209 None] Lock "cinder-quobyte-53b7026a-5f05-4e2a-b07d-59da52285f01" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b536e67c-e0d9-489c-9202-74ee400959b4 tempest-VolumeDependencyTests-731872209 None] Acquiring lock "cinder-quobyte-33e06052-4108-42f4-8fbb-2c4b1debef31" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b536e67c-e0d9-489c-9202-74ee400959b4 tempest-VolumeDependencyTests-731872209 None] Lock "cinder-quobyte-33e06052-4108-42f4-8fbb-2c4b1debef31" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-b536e67c-e0d9-489c-9202-74ee400959b4 tempest-VolumeDependencyTests-731872209 None] Deleting offline snapshot 33e06052-4108-42f4-8fbb-2c4b1debef31 of volume 53b7026a-5f05-4e2a-b07d-59da52285f01 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:18:43 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-b536e67c-e0d9-489c-9202-74ee400959b4 tempest-VolumeDependencyTests-731872209 None] snapshot_file for this snap is: volume-53b7026a-5f05-4e2a-b07d-59da52285f01.33e06052-4108-42f4-8fbb-2c4b1debef31 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2df8c444-0965-4b24-9398-2d51bab28f6c tempest-CinderUnicodeTest-290536026 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737" returned: 0 in 0.615s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2df8c444-0965-4b24-9398-2d51bab28f6c tempest-CinderUnicodeTest-290536026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.ca30a852-903f-43f7-a6de-94ee92696ea7 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92e43df-a253-4575-8f9d-149ea7b65b43]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:43 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b536e67c-e0d9-489c-9202-74ee400959b4 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.33e06052-4108-42f4-8fbb-2c4b1debef31 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:43 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.ca30a852-903f-43f7-a6de-94ee92696ea7 1G Apr 27 10:18:43 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:44 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.33e06052-4108-42f4-8fbb-2c4b1debef31 Apr 27 10:18:44 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:44 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fdd05842-37cb-4f3a-b821-00e0ebb96c5b tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.462s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:44 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-fdd05842-37cb-4f3a-b821-00e0ebb96c5b tempest-CreateVolumesFromSnapshotTest-1571585239 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:18:44 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-fdd05842-37cb-4f3a-b821-00e0ebb96c5b tempest-CreateVolumesFromSnapshotTest-1571585239 None] Deleted volume successfully. Apr 27 10:18:44 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-fdd05842-37cb-4f3a-b821-00e0ebb96c5b tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-06f4d82b-4440-485f-b2cc-f7ceb011bec1-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:44 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b536e67c-e0d9-489c-9202-74ee400959b4 tempest-VolumeDependencyTests-731872209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.33e06052-4108-42f4-8fbb-2c4b1debef31" returned: 0 in 0.567s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:44 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-b536e67c-e0d9-489c-9202-74ee400959b4 tempest-VolumeDependencyTests-731872209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53b7026a-5f05-4e2a-b07d-59da52285f01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:18:44 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc45723d-33f4-43b9-9414-94d7a13c26a3]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b536e67c-e0d9-489c-9202-74ee400959b4 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:44 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2df8c444-0965-4b24-9398-2d51bab28f6c tempest-CinderUnicodeTest-290536026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.ca30a852-903f-43f7-a6de-94ee92696ea7 1G" returned: 0 in 0.625s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2df8c444-0965-4b24-9398-2d51bab28f6c tempest-CinderUnicodeTest-290536026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78bd5508-1b8c-486c-8af0-41f79db3f737 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.ca30a852-903f-43f7-a6de-94ee92696ea7 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:44 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78bd5508-1b8c-486c-8af0-41f79db3f737 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.ca30a852-903f-43f7-a6de-94ee92696ea7 Apr 27 10:18:44 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:44 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01 Apr 27 10:18:44 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:44 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-60b94dc5-5f10-4533-979e-3c11c14e2f47 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "cinder-426ab364-47ed-4f29-806b-ca511bac5cdf-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:44 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-60b94dc5-5f10-4533-979e-3c11c14e2f47 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-426ab364-47ed-4f29-806b-ca511bac5cdf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:44 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-60b94dc5-5f10-4533-979e-3c11c14e2f47 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "cinder-quobyte-426ab364-47ed-4f29-806b-ca511bac5cdf" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:44 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-60b94dc5-5f10-4533-979e-3c11c14e2f47 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-quobyte-426ab364-47ed-4f29-806b-ca511bac5cdf" acquired by "delete_volume" :: waited 0.014s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:44 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8dc5a3-7b22-43d6-9960-d18aff7ade88]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:44 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-60b94dc5-5f10-4533-979e-3c11c14e2f47 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-426ab364-47ed-4f29-806b-ca511bac5cdf {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:44 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-426ab364-47ed-4f29-806b-ca511bac5cdf Apr 27 10:18:44 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:45 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b536e67c-e0d9-489c-9202-74ee400959b4 tempest-VolumeDependencyTests-731872209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01" returned: 0 in 0.550s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b536e67c-e0d9-489c-9202-74ee400959b4 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.33e06052-4108-42f4-8fbb-2c4b1debef31 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:45 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.33e06052-4108-42f4-8fbb-2c4b1debef31 Apr 27 10:18:45 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:45 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2df8c444-0965-4b24-9398-2d51bab28f6c tempest-CinderUnicodeTest-290536026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78bd5508-1b8c-486c-8af0-41f79db3f737 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.ca30a852-903f-43f7-a6de-94ee92696ea7" returned: 0 in 0.575s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:45 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-2df8c444-0965-4b24-9398-2d51bab28f6c tempest-CinderUnicodeTest-290536026 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.ca30a852-903f-43f7-a6de-94ee92696ea7 is being set with open permissions: ugo+rw Apr 27 10:18:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2df8c444-0965-4b24-9398-2d51bab28f6c tempest-CinderUnicodeTest-290536026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.ca30a852-903f-43f7-a6de-94ee92696ea7 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:45 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.ca30a852-903f-43f7-a6de-94ee92696ea7 Apr 27 10:18:45 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:45 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-60b94dc5-5f10-4533-979e-3c11c14e2f47 tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-426ab364-47ed-4f29-806b-ca511bac5cdf" returned: 0 in 0.531s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-60b94dc5-5f10-4533-979e-3c11c14e2f47 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-426ab364-47ed-4f29-806b-ca511bac5cdf {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:45 devstack sudo[90693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-426ab364-47ed-4f29-806b-ca511bac5cdf Apr 27 10:18:45 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:45 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2df8c444-0965-4b24-9398-2d51bab28f6c tempest-CinderUnicodeTest-290536026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.ca30a852-903f-43f7-a6de-94ee92696ea7" returned: 0 in 0.440s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2df8c444-0965-4b24-9398-2d51bab28f6c tempest-CinderUnicodeTest-290536026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:45 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.info Apr 27 10:18:45 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:45 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b536e67c-e0d9-489c-9202-74ee400959b4 tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.33e06052-4108-42f4-8fbb-2c4b1debef31" returned: 0 in 0.595s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b536e67c-e0d9-489c-9202-74ee400959b4 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.33e06052-4108-42f4-8fbb-2c4b1debef31 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:45 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.33e06052-4108-42f4-8fbb-2c4b1debef31 Apr 27 10:18:45 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:45 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-60b94dc5-5f10-4533-979e-3c11c14e2f47 tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-426ab364-47ed-4f29-806b-ca511bac5cdf" returned: 0 in 0.459s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:45 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-60b94dc5-5f10-4533-979e-3c11c14e2f47 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-quobyte-426ab364-47ed-4f29-806b-ca511bac5cdf" released by "delete_volume" :: held 1.048s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:45 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-60b94dc5-5f10-4533-979e-3c11c14e2f47 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Created reservations ['c6e954bf-3e5a-4f25-87ab-15910934b678', '1bb488a8-620d-48ee-ba8a-dba48ac25d3b', '989fd7a6-b167-4ae7-9543-ff1050fd6753', '5b3f47f2-0ef4-4ed0-9d84-ef32972e73b2'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:18:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-60b94dc5-5f10-4533-979e-3c11c14e2f47 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-60b94dc5-5f10-4533-979e-3c11c14e2f47 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:45 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-60b94dc5-5f10-4533-979e-3c11c14e2f47 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:45 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-60b94dc5-5f10-4533-979e-3c11c14e2f47 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-60b94dc5-5f10-4533-979e-3c11c14e2f47 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:45 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-60b94dc5-5f10-4533-979e-3c11c14e2f47 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:46 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:18:46 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:46 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2df8c444-0965-4b24-9398-2d51bab28f6c tempest-CinderUnicodeTest-290536026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.info" returned: 0 in 0.485s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:46 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-2df8c444-0965-4b24-9398-2d51bab28f6c tempest-CinderUnicodeTest-290536026 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.info is being set with open permissions: ugo+rw Apr 27 10:18:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2df8c444-0965-4b24-9398-2d51bab28f6c tempest-CinderUnicodeTest-290536026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:46 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.info Apr 27 10:18:46 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:46 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b536e67c-e0d9-489c-9202-74ee400959b4 tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01.33e06052-4108-42f4-8fbb-2c4b1debef31" returned: 0 in 0.514s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:46 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b536e67c-e0d9-489c-9202-74ee400959b4 tempest-VolumeDependencyTests-731872209 None] Lock "cinder-quobyte-33e06052-4108-42f4-8fbb-2c4b1debef31" released by "_delete_snapshot" :: held 2.325s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:46 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b536e67c-e0d9-489c-9202-74ee400959b4 tempest-VolumeDependencyTests-731872209 None] Lock "cinder-quobyte-53b7026a-5f05-4e2a-b07d-59da52285f01" released by "delete_snapshot" :: held 2.348s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:46 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-b536e67c-e0d9-489c-9202-74ee400959b4 tempest-VolumeDependencyTests-731872209 None] Created reservations ['082124f2-34e2-4c74-9ff8-c984ecaaba68', '41972ab8-8a21-46df-97b7-b28d0b650b5a', '6ca9edb7-bd2c-45df-8d09-25f0c25b0811', '2a7d163f-3d7d-4d5c-abec-8399b3d051c0'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:18:46 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-b536e67c-e0d9-489c-9202-74ee400959b4 tempest-VolumeDependencyTests-731872209 None] Delete snapshot completed successfully. Apr 27 10:18:46 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b536e67c-e0d9-489c-9202-74ee400959b4 tempest-VolumeDependencyTests-731872209 None] Lock "cinder-33e06052-4108-42f4-8fbb-2c4b1debef31-delete_snapshot" released by "delete_snapshot" :: held 2.474s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:46 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-60b94dc5-5f10-4533-979e-3c11c14e2f47 tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.459s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:46 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-60b94dc5-5f10-4533-979e-3c11c14e2f47 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:18:46 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-60b94dc5-5f10-4533-979e-3c11c14e2f47 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Deleted volume successfully. Apr 27 10:18:46 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-60b94dc5-5f10-4533-979e-3c11c14e2f47 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-426ab364-47ed-4f29-806b-ca511bac5cdf-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:46 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2df8c444-0965-4b24-9398-2d51bab28f6c tempest-CinderUnicodeTest-290536026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.info" returned: 0 in 0.503s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2df8c444-0965-4b24-9398-2d51bab28f6c tempest-CinderUnicodeTest-290536026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.355s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.506s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:46 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1617343264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ae8210-befd-45da-9ab9-ca922664b06a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e9f05089fa4202b801bb8d71bdce80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:36Z,use_quota=True,user_id='b401138a80c14f87a07dfa920c8ad7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:18:46 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Creating volume 57ae8210-befd-45da-9ab9-ca922664b06a {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:18:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:46 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:46 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:46 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:18:46 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:18:46 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57ae8210-befd-45da-9ab9-ca922664b06a 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:46 devstack sudo[90712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57ae8210-befd-45da-9ab9-ca922664b06a 1073741824 Apr 27 10:18:46 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:46 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-2df8c444-0965-4b24-9398-2d51bab28f6c tempest-CinderUnicodeTest-290536026 None] Create snapshot completed successfully Apr 27 10:18:46 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8c721b88-bfbc-4bd7-9114-a9008404a69a tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "cinder-d2d23859-8812-4e50-80e6-5782353e6edb-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:46 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8c721b88-bfbc-4bd7-9114-a9008404a69a tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-d2d23859-8812-4e50-80e6-5782353e6edb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8c721b88-bfbc-4bd7-9114-a9008404a69a tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "cinder-quobyte-d2d23859-8812-4e50-80e6-5782353e6edb" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8c721b88-bfbc-4bd7-9114-a9008404a69a tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-quobyte-d2d23859-8812-4e50-80e6-5782353e6edb" acquired by "delete_volume" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62e38cc-08bb-4169-ab4e-5dae69a48d79]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c721b88-bfbc-4bd7-9114-a9008404a69a tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2d23859-8812-4e50-80e6-5782353e6edb {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3546d188-7e5f-4001-a2eb-2c98924ca342 tempest-VolumeDependencyTests-731872209 None] Acquiring lock "cinder-53b7026a-5f05-4e2a-b07d-59da52285f01-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c5cdcdca-09d1-4cf2-9d00-c2046b66dc85 tempest-CinderUnicodeTest-290536026 None] Acquiring lock "cinder-ca30a852-903f-43f7-a6de-94ee92696ea7-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c5cdcdca-09d1-4cf2-9d00-c2046b66dc85 tempest-CinderUnicodeTest-290536026 None] Lock "cinder-ca30a852-903f-43f7-a6de-94ee92696ea7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c5cdcdca-09d1-4cf2-9d00-c2046b66dc85 tempest-CinderUnicodeTest-290536026 None] Acquiring lock "cinder-quobyte-78bd5508-1b8c-486c-8af0-41f79db3f737" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3546d188-7e5f-4001-a2eb-2c98924ca342 tempest-VolumeDependencyTests-731872209 None] Lock "cinder-53b7026a-5f05-4e2a-b07d-59da52285f01-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c5cdcdca-09d1-4cf2-9d00-c2046b66dc85 tempest-CinderUnicodeTest-290536026 None] Lock "cinder-quobyte-78bd5508-1b8c-486c-8af0-41f79db3f737" acquired by "delete_snapshot" :: waited 0.039s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c5cdcdca-09d1-4cf2-9d00-c2046b66dc85 tempest-CinderUnicodeTest-290536026 None] Acquiring lock "cinder-quobyte-ca30a852-903f-43f7-a6de-94ee92696ea7" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:47 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2d23859-8812-4e50-80e6-5782353e6edb Apr 27 10:18:47 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3546d188-7e5f-4001-a2eb-2c98924ca342 tempest-VolumeDependencyTests-731872209 None] Acquiring lock "cinder-quobyte-53b7026a-5f05-4e2a-b07d-59da52285f01" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c5cdcdca-09d1-4cf2-9d00-c2046b66dc85 tempest-CinderUnicodeTest-290536026 None] Lock "cinder-quobyte-ca30a852-903f-43f7-a6de-94ee92696ea7" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-c5cdcdca-09d1-4cf2-9d00-c2046b66dc85 tempest-CinderUnicodeTest-290536026 None] Deleting offline snapshot ca30a852-903f-43f7-a6de-94ee92696ea7 of volume 78bd5508-1b8c-486c-8af0-41f79db3f737 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-c5cdcdca-09d1-4cf2-9d00-c2046b66dc85 tempest-CinderUnicodeTest-290536026 None] snapshot_file for this snap is: volume-78bd5508-1b8c-486c-8af0-41f79db3f737.ca30a852-903f-43f7-a6de-94ee92696ea7 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3546d188-7e5f-4001-a2eb-2c98924ca342 tempest-VolumeDependencyTests-731872209 None] Lock "cinder-quobyte-53b7026a-5f05-4e2a-b07d-59da52285f01" acquired by "delete_volume" :: waited 0.041s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[960293c0-dca7-44f4-9b8a-98dff600a5f6]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c5cdcdca-09d1-4cf2-9d00-c2046b66dc85 tempest-CinderUnicodeTest-290536026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.ca30a852-903f-43f7-a6de-94ee92696ea7 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc52a79-17e0-4b0c-bccc-fa4b0c154e1d]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3546d188-7e5f-4001-a2eb-2c98924ca342 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:47 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57ae8210-befd-45da-9ab9-ca922664b06a 1073741824" returned: 0 in 0.701s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57ae8210-befd-45da-9ab9-ca922664b06a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:47 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.ca30a852-903f-43f7-a6de-94ee92696ea7 Apr 27 10:18:47 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:47 devstack sudo[90722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57ae8210-befd-45da-9ab9-ca922664b06a Apr 27 10:18:47 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:47 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01 Apr 27 10:18:47 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:47 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c721b88-bfbc-4bd7-9114-a9008404a69a tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2d23859-8812-4e50-80e6-5782353e6edb" returned: 0 in 0.619s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c721b88-bfbc-4bd7-9114-a9008404a69a tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2d23859-8812-4e50-80e6-5782353e6edb {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:47 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2d23859-8812-4e50-80e6-5782353e6edb Apr 27 10:18:47 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:47 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3546d188-7e5f-4001-a2eb-2c98924ca342 tempest-VolumeDependencyTests-731872209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01" returned: 0 in 0.513s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3546d188-7e5f-4001-a2eb-2c98924ca342 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:47 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57ae8210-befd-45da-9ab9-ca922664b06a" returned: 0 in 0.479s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:47 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c5cdcdca-09d1-4cf2-9d00-c2046b66dc85 tempest-CinderUnicodeTest-290536026 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.ca30a852-903f-43f7-a6de-94ee92696ea7" returned: 0 in 0.567s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-c5cdcdca-09d1-4cf2-9d00-c2046b66dc85 tempest-CinderUnicodeTest-290536026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78bd5508-1b8c-486c-8af0-41f79db3f737(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:18:47 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01 Apr 27 10:18:47 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c239b7b-0b76-41e5-9ca7-24d832a84c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57ae8210-befd-45da-9ab9-ca922664b06a', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84394fe3-4f6f-40f5-9aa0-8676c3cadf0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab4c3a3-f5ef-46a9-9715-badbe936422a]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c5cdcdca-09d1-4cf2-9d00-c2046b66dc85 tempest-CinderUnicodeTest-290536026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:47 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Volume volume-57ae8210-befd-45da-9ab9-ca922664b06a (57ae8210-befd-45da-9ab9-ca922664b06a): created successfully Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84394fe3-4f6f-40f5-9aa0-8676c3cadf0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:47 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Flow 'volume_create_manager' (7a0341de-3f52-4725-b8a6-73e76a5d316d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:47 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-f1d5e2bb-910a-4d2e-af5a-93137572a50a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Created volume successfully. Apr 27 10:18:47 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737 Apr 27 10:18:47 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:48 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c721b88-bfbc-4bd7-9114-a9008404a69a tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d2d23859-8812-4e50-80e6-5782353e6edb" returned: 0 in 0.625s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8c721b88-bfbc-4bd7-9114-a9008404a69a tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-quobyte-d2d23859-8812-4e50-80e6-5782353e6edb" released by "delete_volume" :: held 1.291s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-8c721b88-bfbc-4bd7-9114-a9008404a69a tempest-CreateVolumesFromSnapshotTest-1571585239 None] Created reservations ['093e15cf-ddf0-4e66-9427-de731bda539a', '9b11cca4-2e64-4bfe-89ac-29324d36c21e', '7fc4af45-5ad4-4b3b-b30b-53b676460b14', '9f803a2b-4c55-42f1-9f47-556c2eae687e'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8c721b88-bfbc-4bd7-9114-a9008404a69a tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8c721b88-bfbc-4bd7-9114-a9008404a69a tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8c721b88-bfbc-4bd7-9114-a9008404a69a tempest-CreateVolumesFromSnapshotTest-1571585239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8c721b88-bfbc-4bd7-9114-a9008404a69a tempest-CreateVolumesFromSnapshotTest-1571585239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8c721b88-bfbc-4bd7-9114-a9008404a69a tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c721b88-bfbc-4bd7-9114-a9008404a69a tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:48 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:18:48 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Flow 'volume_create_manager' (b0eb98ca-5a07-45b7-8e66-0fb223a6f227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5833533-a5d5-478b-9905-9b1a18cf2c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:48 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5833533-a5d5-478b-9905-9b1a18cf2c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1841168191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f69c7d-a069-41cb-b24a-517978f97be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e9f05089fa4202b801bb8d71bdce80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:48Z,use_quota=True,user_id='b401138a80c14f87a07dfa920c8ad7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c52ee3-d1b1-467b-b85c-924885533317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c52ee3-d1b1-467b-b85c-924885533317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecbdef03-7066-498f-935a-59c4c78f49d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecbdef03-7066-498f-935a-59c4c78f49d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37f69c7d-a069-41cb-b24a-517978f97be9', 'volume_name': 'volume-37f69c7d-a069-41cb-b24a-517978f97be9', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a9160f-f66f-4b14-b433-6ed02f0e82ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a9160f-f66f-4b14-b433-6ed02f0e82ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9959ce03-237e-4ce6-9ddd-0e4b1374124e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:48 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Volume 37f69c7d-a069-41cb-b24a-517978f97be9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37f69c7d-a069-41cb-b24a-517978f97be9', 'volume_size': 1} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1841168191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f69c7d-a069-41cb-b24a-517978f97be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e9f05089fa4202b801bb8d71bdce80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:48Z,use_quota=True,user_id='b401138a80c14f87a07dfa920c8ad7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Creating volume 37f69c7d-a069-41cb-b24a-517978f97be9 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:18:48 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-37f69c7d-a069-41cb-b24a-517978f97be9 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3546d188-7e5f-4001-a2eb-2c98924ca342 tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-53b7026a-5f05-4e2a-b07d-59da52285f01" returned: 0 in 0.793s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:48 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3546d188-7e5f-4001-a2eb-2c98924ca342 tempest-VolumeDependencyTests-731872209 None] Lock "cinder-quobyte-53b7026a-5f05-4e2a-b07d-59da52285f01" released by "delete_volume" :: held 1.377s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c5cdcdca-09d1-4cf2-9d00-c2046b66dc85 tempest-CinderUnicodeTest-290536026 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737" returned: 0 in 0.745s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c5cdcdca-09d1-4cf2-9d00-c2046b66dc85 tempest-CinderUnicodeTest-290536026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.ca30a852-903f-43f7-a6de-94ee92696ea7 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:48 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-37f69c7d-a069-41cb-b24a-517978f97be9 1073741824 Apr 27 10:18:48 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:48 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.ca30a852-903f-43f7-a6de-94ee92696ea7 Apr 27 10:18:48 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-3546d188-7e5f-4001-a2eb-2c98924ca342 tempest-VolumeDependencyTests-731872209 None] Created reservations ['7e7669a2-be4a-46e5-ae2d-e45f141ef483', '97764736-2561-4963-b76e-b46ce13b2bba', 'b003147f-a224-4afc-9432-9efdf5f01089', '77e54d09-1c7f-4943-a06e-1e210faff507'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3546d188-7e5f-4001-a2eb-2c98924ca342 tempest-VolumeDependencyTests-731872209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3546d188-7e5f-4001-a2eb-2c98924ca342 tempest-VolumeDependencyTests-731872209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3546d188-7e5f-4001-a2eb-2c98924ca342 tempest-VolumeDependencyTests-731872209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3546d188-7e5f-4001-a2eb-2c98924ca342 tempest-VolumeDependencyTests-731872209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3546d188-7e5f-4001-a2eb-2c98924ca342 tempest-VolumeDependencyTests-731872209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3546d188-7e5f-4001-a2eb-2c98924ca342 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:18:48 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:18:48 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Flow 'volume_create_manager' (c0092d95-0160-4450-ba9b-0bbe65ce76b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36dd362-1eff-4372-b7e4-3fd090963303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36dd362-1eff-4372-b7e4-3fd090963303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1802457992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e9f05089fa4202b801bb8d71bdce80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:49Z,use_quota=True,user_id='b401138a80c14f87a07dfa920c8ad7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83dc64e0-501b-47db-a21b-45bd59679aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83dc64e0-501b-47db-a21b-45bd59679aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d9a40c-8b89-4cc3-a51a-733806f17433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d9a40c-8b89-4cc3-a51a-733806f17433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9da49d0-c9fd-4ca0-b86a-f102f0f1a5de', 'volume_name': 'volume-d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36519af6-28b0-4bc6-b282-c314bcab1493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36519af6-28b0-4bc6-b282-c314bcab1493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1292b98a-5d76-4d12-9b61-77832d8bc57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:48 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Volume d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de', 'volume_size': 1} Apr 27 10:18:48 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:49 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8c721b88-bfbc-4bd7-9114-a9008404a69a tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.762s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-8c721b88-bfbc-4bd7-9114-a9008404a69a tempest-CreateVolumesFromSnapshotTest-1571585239 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:18:49 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-8c721b88-bfbc-4bd7-9114-a9008404a69a tempest-CreateVolumesFromSnapshotTest-1571585239 None] Deleted volume successfully. Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8c721b88-bfbc-4bd7-9114-a9008404a69a tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-d2d23859-8812-4e50-80e6-5782353e6edb-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b9163c14-4147-4834-ac03-8063131e0492 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "cinder-6632eee0-d06e-441b-a9c4-231b2b830f2f-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b9163c14-4147-4834-ac03-8063131e0492 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-6632eee0-d06e-441b-a9c4-231b2b830f2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b9163c14-4147-4834-ac03-8063131e0492 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "cinder-quobyte-1b9b990b-228b-4169-8a3b-4dba9cfa4529" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b9163c14-4147-4834-ac03-8063131e0492 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-quobyte-1b9b990b-228b-4169-8a3b-4dba9cfa4529" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b9163c14-4147-4834-ac03-8063131e0492 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "cinder-quobyte-6632eee0-d06e-441b-a9c4-231b2b830f2f" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b9163c14-4147-4834-ac03-8063131e0492 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-quobyte-6632eee0-d06e-441b-a9c4-231b2b830f2f" acquired by "_delete_snapshot" :: waited 0.065s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-b9163c14-4147-4834-ac03-8063131e0492 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Deleting offline snapshot 6632eee0-d06e-441b-a9c4-231b2b830f2f of volume 1b9b990b-228b-4169-8a3b-4dba9cfa4529 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:18:49 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-b9163c14-4147-4834-ac03-8063131e0492 tempest-CreateVolumesFromSnapshotTest-1571585239 None] snapshot_file for this snap is: volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.6632eee0-d06e-441b-a9c4-231b2b830f2f {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c5cdcdca-09d1-4cf2-9d00-c2046b66dc85 tempest-CinderUnicodeTest-290536026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.ca30a852-903f-43f7-a6de-94ee92696ea7" returned: 0 in 0.821s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c5cdcdca-09d1-4cf2-9d00-c2046b66dc85 tempest-CinderUnicodeTest-290536026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.ca30a852-903f-43f7-a6de-94ee92696ea7 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c5c936-c5ee-4eb1-b10d-4469ac3a9381]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b9163c14-4147-4834-ac03-8063131e0492 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.6632eee0-d06e-441b-a9c4-231b2b830f2f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:49 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.ca30a852-903f-43f7-a6de-94ee92696ea7 Apr 27 10:18:49 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Flow 'volume_create_manager' (2e5887dd-6110-45af-ae76-5c30ed83219a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2fc5273-81df-41ce-8da3-b3156836d7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:49 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3546d188-7e5f-4001-a2eb-2c98924ca342 tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.849s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-3546d188-7e5f-4001-a2eb-2c98924ca342 tempest-VolumeDependencyTests-731872209 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:18:49 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-3546d188-7e5f-4001-a2eb-2c98924ca342 tempest-VolumeDependencyTests-731872209 None] Deleted volume successfully. Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2fc5273-81df-41ce-8da3-b3156836d7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1015399233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6271af9f-66af-4259-bfdb-0722569ce9cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e9f05089fa4202b801bb8d71bdce80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:49Z,use_quota=True,user_id='b401138a80c14f87a07dfa920c8ad7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:49 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.6632eee0-d06e-441b-a9c4-231b2b830f2f Apr 27 10:18:49 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec6635c-8658-41f6-b75d-002b870d150c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec6635c-8658-41f6-b75d-002b870d150c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0396ba3e-8caf-4af2-abd0-5141c0ef7807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0396ba3e-8caf-4af2-abd0-5141c0ef7807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6271af9f-66af-4259-bfdb-0722569ce9cd', 'volume_name': 'volume-6271af9f-66af-4259-bfdb-0722569ce9cd', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884d7320-a094-4781-a5e5-9688e35cbb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884d7320-a094-4781-a5e5-9688e35cbb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa263554-5d66-4da0-a117-87b31b71b900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:49 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Volume 6271af9f-66af-4259-bfdb-0722569ce9cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6271af9f-66af-4259-bfdb-0722569ce9cd', 'volume_size': 1} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:49 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Flow 'volume_create_manager' (854880ee-0d12-424a-8a8f-45db55242ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a5d8a4-d5b6-494c-9f85-5da495ef1f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-37f69c7d-a069-41cb-b24a-517978f97be9 1073741824" returned: 0 in 1.395s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:49 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-3546d188-7e5f-4001-a2eb-2c98924ca342 tempest-VolumeDependencyTests-731872209 None] Lock "cinder-53b7026a-5f05-4e2a-b07d-59da52285f01-delete_volume" released by "delete_volume" :: held 2.845s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a5d8a4-d5b6-494c-9f85-5da495ef1f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-987909777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a786f1b0-05e4-4299-a7ec-242b07b65bb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e9f05089fa4202b801bb8d71bdce80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:50Z,use_quota=True,user_id='b401138a80c14f87a07dfa920c8ad7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91dd127-01f9-4fda-946d-9a372cf0d412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91dd127-01f9-4fda-946d-9a372cf0d412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60146607-fc1a-4f85-ad20-f67e5bd5317c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60146607-fc1a-4f85-ad20-f67e5bd5317c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a786f1b0-05e4-4299-a7ec-242b07b65bb2', 'volume_name': 'volume-a786f1b0-05e4-4299-a7ec-242b07b65bb2', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d6afdd-7157-405d-a937-c908f9e511fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d6afdd-7157-405d-a937-c908f9e511fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f65a8b-e6c3-4713-9246-66e3682864a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:50 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Volume a786f1b0-05e4-4299-a7ec-242b07b65bb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a786f1b0-05e4-4299-a7ec-242b07b65bb2', 'volume_size': 1} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-37f69c7d-a069-41cb-b24a-517978f97be9 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:50 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-37f69c7d-a069-41cb-b24a-517978f97be9 Apr 27 10:18:50 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Flow 'volume_create_manager' (be98eeb1-5cd4-42f0-9dc4-6d105e4ca438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b553f7-aa23-4351-ade9-3856bf4d0dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Flow 'volume_create_manager' (8e379d30-5aff-41a7-b391-5ad91be48195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a22b6ed-8b04-474f-a1de-6661cc97a3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a22b6ed-8b04-474f-a1de-6661cc97a3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-951350420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69638d6c-fc70-43a5-93f5-6a4daa430444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='958b8fcd112b4e538e321c80389b7a02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:50Z,use_quota=True,user_id='d84b90f4c6a749a18799b88589605c82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76190015-d75b-4fc2-b7c7-d3e0252abaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76190015-d75b-4fc2-b7c7-d3e0252abaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51011dd0-e5b0-4503-bf05-6f919a04f4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51011dd0-e5b0-4503-bf05-6f919a04f4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69638d6c-fc70-43a5-93f5-6a4daa430444', 'volume_name': 'volume-69638d6c-fc70-43a5-93f5-6a4daa430444', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151ae298-9df8-4d1d-a703-586dcfce49fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151ae298-9df8-4d1d-a703-586dcfce49fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777d63f7-3979-4f24-92e0-a74ad0a0c8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:50 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Volume 69638d6c-fc70-43a5-93f5-6a4daa430444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69638d6c-fc70-43a5-93f5-6a4daa430444', 'volume_size': 1} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:50 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b553f7-aa23-4351-ade9-3856bf4d0dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1224189120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c16469-cd04-4748-9a1d-2012fede7a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e9f05089fa4202b801bb8d71bdce80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:50Z,use_quota=True,user_id='b401138a80c14f87a07dfa920c8ad7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (610e88e3-280e-4b8b-ab65-31ab6fa5cf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (610e88e3-280e-4b8b-ab65-31ab6fa5cf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865a59a8-7525-4c16-ae0e-576bcfb7c43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865a59a8-7525-4c16-ae0e-576bcfb7c43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12c16469-cd04-4748-9a1d-2012fede7a8f', 'volume_name': 'volume-12c16469-cd04-4748-9a1d-2012fede7a8f', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5914489b-1964-4f0e-aa67-17c8353e6f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5914489b-1964-4f0e-aa67-17c8353e6f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391ae394-2dc1-44bd-a1c1-f424c326e97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:50 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Volume 12c16469-cd04-4748-9a1d-2012fede7a8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12c16469-cd04-4748-9a1d-2012fede7a8f', 'volume_size': 1} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c5cdcdca-09d1-4cf2-9d00-c2046b66dc85 tempest-CinderUnicodeTest-290536026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737.ca30a852-903f-43f7-a6de-94ee92696ea7" returned: 0 in 0.888s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c5cdcdca-09d1-4cf2-9d00-c2046b66dc85 tempest-CinderUnicodeTest-290536026 None] Lock "cinder-quobyte-ca30a852-903f-43f7-a6de-94ee92696ea7" released by "_delete_snapshot" :: held 3.156s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c5cdcdca-09d1-4cf2-9d00-c2046b66dc85 tempest-CinderUnicodeTest-290536026 None] Lock "cinder-quobyte-78bd5508-1b8c-486c-8af0-41f79db3f737" released by "delete_snapshot" :: held 3.194s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:50 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b9163c14-4147-4834-ac03-8063131e0492 tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.6632eee0-d06e-441b-a9c4-231b2b830f2f" returned: 0 in 0.924s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-b9163c14-4147-4834-ac03-8063131e0492 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa161c1-cc93-4951-bbc8-ad2f9a49d5b5]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b9163c14-4147-4834-ac03-8063131e0492 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-c5cdcdca-09d1-4cf2-9d00-c2046b66dc85 tempest-CinderUnicodeTest-290536026 None] Created reservations ['f88e0708-8b4d-4cef-8570-cad61b642525', 'aa30444c-4828-4362-a97c-211b59109156', '4e25b96b-4e6b-4171-86bf-528af44af08b', '96aec800-982a-4010-90ee-9c3f15c84ebe'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:18:50 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-c5cdcdca-09d1-4cf2-9d00-c2046b66dc85 tempest-CinderUnicodeTest-290536026 None] Delete snapshot completed successfully. Apr 27 10:18:50 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529 Apr 27 10:18:50 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-c5cdcdca-09d1-4cf2-9d00-c2046b66dc85 tempest-CinderUnicodeTest-290536026 None] Lock "cinder-ca30a852-903f-43f7-a6de-94ee92696ea7-delete_snapshot" released by "delete_snapshot" :: held 3.383s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:50 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-37f69c7d-a069-41cb-b24a-517978f97be9" returned: 0 in 0.561s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] <== create_volume: return (2100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.103s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.766s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1802457992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e9f05089fa4202b801bb8d71bdce80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:49Z,use_quota=True,user_id='b401138a80c14f87a07dfa920c8ad7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Creating volume d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:18:50 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:50 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de 1073741824 Apr 27 10:18:50 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9959ce03-237e-4ce6-9ddd-0e4b1374124e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37f69c7d-a069-41cb-b24a-517978f97be9', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e651b25-9239-4fb3-af6e-fd11afba08ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:50 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Volume volume-37f69c7d-a069-41cb-b24a-517978f97be9 (37f69c7d-a069-41cb-b24a-517978f97be9): created successfully Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e651b25-9239-4fb3-af6e-fd11afba08ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Flow 'volume_create_manager' (b0eb98ca-5a07-45b7-8e66-0fb223a6f227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:50 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-b64b5880-4783-4013-8f04-7d9833123141 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Created volume successfully. Apr 27 10:18:50 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b9163c14-4147-4834-ac03-8063131e0492 tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529" returned: 0 in 0.540s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:50 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b9163c14-4147-4834-ac03-8063131e0492 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.6632eee0-d06e-441b-a9c4-231b2b830f2f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:50 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.6632eee0-d06e-441b-a9c4-231b2b830f2f Apr 27 10:18:50 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:51 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de 1073741824" returned: 0 in 0.639s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:51 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de Apr 27 10:18:51 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8d23c053-9123-4792-9f2e-7d19ef54c487 tempest-CinderUnicodeTest-290536026 None] Acquiring lock "cinder-78bd5508-1b8c-486c-8af0-41f79db3f737-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8d23c053-9123-4792-9f2e-7d19ef54c487 tempest-CinderUnicodeTest-290536026 None] Lock "cinder-78bd5508-1b8c-486c-8af0-41f79db3f737-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8d23c053-9123-4792-9f2e-7d19ef54c487 tempest-CinderUnicodeTest-290536026 None] Acquiring lock "cinder-quobyte-78bd5508-1b8c-486c-8af0-41f79db3f737" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:51 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8d23c053-9123-4792-9f2e-7d19ef54c487 tempest-CinderUnicodeTest-290536026 None] Lock "cinder-quobyte-78bd5508-1b8c-486c-8af0-41f79db3f737" acquired by "delete_volume" :: waited 0.020s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b9163c14-4147-4834-ac03-8063131e0492 tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.6632eee0-d06e-441b-a9c4-231b2b830f2f" returned: 0 in 0.651s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b9163c14-4147-4834-ac03-8063131e0492 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.6632eee0-d06e-441b-a9c4-231b2b830f2f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f513e0-ed9c-4a09-9334-67a8cfede55a]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8d23c053-9123-4792-9f2e-7d19ef54c487 tempest-CinderUnicodeTest-290536026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:51 devstack sudo[90791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.6632eee0-d06e-441b-a9c4-231b2b830f2f Apr 27 10:18:51 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:51 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737 Apr 27 10:18:51 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:51 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de" returned: 0 in 0.504s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.076s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1015399233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6271af9f-66af-4259-bfdb-0722569ce9cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e9f05089fa4202b801bb8d71bdce80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:49Z,use_quota=True,user_id='b401138a80c14f87a07dfa920c8ad7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Creating volume 6271af9f-66af-4259-bfdb-0722569ce9cd {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:18:51 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6271af9f-66af-4259-bfdb-0722569ce9cd 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:51 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6271af9f-66af-4259-bfdb-0722569ce9cd 1073741824 Apr 27 10:18:51 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1292b98a-5d76-4d12-9b61-77832d8bc57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a609f9f0-1006-4a3f-8d7f-78d4ea3ba351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:51 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Volume volume-d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de (d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de): created successfully Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a609f9f0-1006-4a3f-8d7f-78d4ea3ba351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:51 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Flow 'volume_create_manager' (c0092d95-0160-4450-ba9b-0bbe65ce76b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:51 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-b9ab80a6-b119-4008-9e96-5c64bee4c9ab tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Created volume successfully. Apr 27 10:18:52 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-b9163c14-4147-4834-ac03-8063131e0492 tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529.6632eee0-d06e-441b-a9c4-231b2b830f2f" returned: 0 in 0.461s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:52 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b9163c14-4147-4834-ac03-8063131e0492 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-quobyte-6632eee0-d06e-441b-a9c4-231b2b830f2f" released by "_delete_snapshot" :: held 2.740s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:52 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b9163c14-4147-4834-ac03-8063131e0492 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-quobyte-1b9b990b-228b-4169-8a3b-4dba9cfa4529" released by "delete_snapshot" :: held 2.816s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:52 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-b9163c14-4147-4834-ac03-8063131e0492 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Created reservations ['6b59ac78-d842-42d0-b901-a27681d2ee2a', '798803a4-b5a2-4299-809a-b3a46862d903', '93f0dbb5-0625-4385-b25c-c1e4001594df', 'ef3c8006-f68b-4f64-907b-2b21d296d12c'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:18:52 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8d23c053-9123-4792-9f2e-7d19ef54c487 tempest-CinderUnicodeTest-290536026 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737" returned: 0 in 0.600s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8d23c053-9123-4792-9f2e-7d19ef54c487 tempest-CinderUnicodeTest-290536026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:52 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737 Apr 27 10:18:52 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:52 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-b9163c14-4147-4834-ac03-8063131e0492 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Delete snapshot completed successfully. Apr 27 10:18:52 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-b9163c14-4147-4834-ac03-8063131e0492 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-6632eee0-d06e-441b-a9c4-231b2b830f2f-delete_snapshot" released by "delete_snapshot" :: held 3.014s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:52 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6271af9f-66af-4259-bfdb-0722569ce9cd 1073741824" returned: 0 in 0.670s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:52 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-0430d03b-5c4f-42bf-9a66-d46a9345dcf4 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "cinder-1b9b990b-228b-4169-8a3b-4dba9cfa4529-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:52 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-0430d03b-5c4f-42bf-9a66-d46a9345dcf4 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-1b9b990b-228b-4169-8a3b-4dba9cfa4529-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6271af9f-66af-4259-bfdb-0722569ce9cd {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:52 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6271af9f-66af-4259-bfdb-0722569ce9cd Apr 27 10:18:52 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:52 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-0430d03b-5c4f-42bf-9a66-d46a9345dcf4 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "cinder-quobyte-1b9b990b-228b-4169-8a3b-4dba9cfa4529" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:52 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-0430d03b-5c4f-42bf-9a66-d46a9345dcf4 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-quobyte-1b9b990b-228b-4169-8a3b-4dba9cfa4529" acquired by "delete_volume" :: waited 0.015s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:52 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0049b9e0-411f-4b13-879f-5f7c50e58f56]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0430d03b-5c4f-42bf-9a66-d46a9345dcf4 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:52 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529 Apr 27 10:18:52 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:52 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8d23c053-9123-4792-9f2e-7d19ef54c487 tempest-CinderUnicodeTest-290536026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-78bd5508-1b8c-486c-8af0-41f79db3f737" returned: 0 in 0.567s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:52 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8d23c053-9123-4792-9f2e-7d19ef54c487 tempest-CinderUnicodeTest-290536026 None] Lock "cinder-quobyte-78bd5508-1b8c-486c-8af0-41f79db3f737" released by "delete_volume" :: held 1.233s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:52 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-8d23c053-9123-4792-9f2e-7d19ef54c487 tempest-CinderUnicodeTest-290536026 None] Created reservations ['df8ce6f9-0eb3-43df-b9af-176b71437a8f', 'ff04d647-8c89-4c9c-b700-af7c0d6cac68', '0c9e5ba6-68ae-4e32-8302-7c0d0a35aa4d', '7ca90a8c-7ac2-47c2-bef5-23c7ef0b8ae4'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:18:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8d23c053-9123-4792-9f2e-7d19ef54c487 tempest-CinderUnicodeTest-290536026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8d23c053-9123-4792-9f2e-7d19ef54c487 tempest-CinderUnicodeTest-290536026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:52 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8d23c053-9123-4792-9f2e-7d19ef54c487 tempest-CinderUnicodeTest-290536026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:52 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-8d23c053-9123-4792-9f2e-7d19ef54c487 tempest-CinderUnicodeTest-290536026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-8d23c053-9123-4792-9f2e-7d19ef54c487 tempest-CinderUnicodeTest-290536026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:52 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8d23c053-9123-4792-9f2e-7d19ef54c487 tempest-CinderUnicodeTest-290536026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:52 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:18:52 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:53 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6271af9f-66af-4259-bfdb-0722569ce9cd" returned: 0 in 0.505s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.037s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-987909777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a786f1b0-05e4-4299-a7ec-242b07b65bb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e9f05089fa4202b801bb8d71bdce80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:50Z,use_quota=True,user_id='b401138a80c14f87a07dfa920c8ad7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Creating volume a786f1b0-05e4-4299-a7ec-242b07b65bb2 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:18:53 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a786f1b0-05e4-4299-a7ec-242b07b65bb2 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa263554-5d66-4da0-a117-87b31b71b900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6271af9f-66af-4259-bfdb-0722569ce9cd', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:53 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a786f1b0-05e4-4299-a7ec-242b07b65bb2 1073741824 Apr 27 10:18:53 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2997e184-a9a8-4b8e-b9b8-ccab1b6d8953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:53 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Volume volume-6271af9f-66af-4259-bfdb-0722569ce9cd (6271af9f-66af-4259-bfdb-0722569ce9cd): created successfully Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2997e184-a9a8-4b8e-b9b8-ccab1b6d8953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Flow 'volume_create_manager' (2e5887dd-6110-45af-ae76-5c30ed83219a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:53 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-6af6b68a-fbe6-4cd2-95e7-a7c76462d5f7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Created volume successfully. Apr 27 10:18:53 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0430d03b-5c4f-42bf-9a66-d46a9345dcf4 tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529" returned: 0 in 0.599s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0430d03b-5c4f-42bf-9a66-d46a9345dcf4 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:53 devstack sudo[90821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529 Apr 27 10:18:53 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:53 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-8d23c053-9123-4792-9f2e-7d19ef54c487 tempest-CinderUnicodeTest-290536026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.486s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-8d23c053-9123-4792-9f2e-7d19ef54c487 tempest-CinderUnicodeTest-290536026 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:18:53 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-8d23c053-9123-4792-9f2e-7d19ef54c487 tempest-CinderUnicodeTest-290536026 None] Deleted volume successfully. Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-8d23c053-9123-4792-9f2e-7d19ef54c487 tempest-CinderUnicodeTest-290536026 None] Lock "cinder-78bd5508-1b8c-486c-8af0-41f79db3f737-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-70c0afbf-c632-4aab-8543-98a5ad291786 tempest-CinderUnicodeTest-290536026 None] Acquiring lock "cinder-224b4517-d29d-414d-823f-3b113d379a03-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-70c0afbf-c632-4aab-8543-98a5ad291786 tempest-CinderUnicodeTest-290536026 None] Lock "cinder-224b4517-d29d-414d-823f-3b113d379a03-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-70c0afbf-c632-4aab-8543-98a5ad291786 tempest-CinderUnicodeTest-290536026 None] Acquiring lock "cinder-quobyte-224b4517-d29d-414d-823f-3b113d379a03" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-70c0afbf-c632-4aab-8543-98a5ad291786 tempest-CinderUnicodeTest-290536026 None] Lock "cinder-quobyte-224b4517-d29d-414d-823f-3b113d379a03" acquired by "delete_volume" :: waited 0.013s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed81698a-406e-4c2d-9be7-a92ebdc5f8df]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-70c0afbf-c632-4aab-8543-98a5ad291786 tempest-CinderUnicodeTest-290536026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-224b4517-d29d-414d-823f-3b113d379a03 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:53 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0430d03b-5c4f-42bf-9a66-d46a9345dcf4 tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-1b9b990b-228b-4169-8a3b-4dba9cfa4529" returned: 0 in 0.546s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:53 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a786f1b0-05e4-4299-a7ec-242b07b65bb2 1073741824" returned: 0 in 0.755s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-0430d03b-5c4f-42bf-9a66-d46a9345dcf4 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-quobyte-1b9b990b-228b-4169-8a3b-4dba9cfa4529" released by "delete_volume" :: held 1.213s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:53 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-224b4517-d29d-414d-823f-3b113d379a03 Apr 27 10:18:53 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a786f1b0-05e4-4299-a7ec-242b07b65bb2 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:53 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a786f1b0-05e4-4299-a7ec-242b07b65bb2 Apr 27 10:18:53 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:53 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-0430d03b-5c4f-42bf-9a66-d46a9345dcf4 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Created reservations ['3578e3b8-2c5c-488f-a95d-790f0709e89f', '4b7fc8bf-d14d-41f5-a953-dddb3b2edb2b', '23a7373c-f939-4ebc-b726-3a30cfd512b6', 'f4761bdd-8941-4cf9-98e0-f361ff33f308'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0430d03b-5c4f-42bf-9a66-d46a9345dcf4 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0430d03b-5c4f-42bf-9a66-d46a9345dcf4 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0430d03b-5c4f-42bf-9a66-d46a9345dcf4 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-0430d03b-5c4f-42bf-9a66-d46a9345dcf4 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-0430d03b-5c4f-42bf-9a66-d46a9345dcf4 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0430d03b-5c4f-42bf-9a66-d46a9345dcf4 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:54 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:18:54 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:54 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-70c0afbf-c632-4aab-8543-98a5ad291786 tempest-CinderUnicodeTest-290536026 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-224b4517-d29d-414d-823f-3b113d379a03" returned: 0 in 0.581s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-70c0afbf-c632-4aab-8543-98a5ad291786 tempest-CinderUnicodeTest-290536026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-224b4517-d29d-414d-823f-3b113d379a03 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:54 devstack sudo[90838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-224b4517-d29d-414d-823f-3b113d379a03 Apr 27 10:18:54 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:54 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a786f1b0-05e4-4299-a7ec-242b07b65bb2" returned: 0 in 0.534s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.166s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-951350420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69638d6c-fc70-43a5-93f5-6a4daa430444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='958b8fcd112b4e538e321c80389b7a02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:50Z,use_quota=True,user_id='d84b90f4c6a749a18799b88589605c82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Creating volume 69638d6c-fc70-43a5-93f5-6a4daa430444 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:18:54 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:54 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f65a8b-e6c3-4713-9246-66e3682864a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a786f1b0-05e4-4299-a7ec-242b07b65bb2', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:54 devstack sudo[90840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444 1073741824 Apr 27 10:18:54 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8077c2dd-fc83-40c6-8e64-49fb54d4be87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-0430d03b-5c4f-42bf-9a66-d46a9345dcf4 tempest-CreateVolumesFromSnapshotTest-1571585239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.479s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-0430d03b-5c4f-42bf-9a66-d46a9345dcf4 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:18:54 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Volume volume-a786f1b0-05e4-4299-a7ec-242b07b65bb2 (a786f1b0-05e4-4299-a7ec-242b07b65bb2): created successfully Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8077c2dd-fc83-40c6-8e64-49fb54d4be87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Flow 'volume_create_manager' (854880ee-0d12-424a-8a8f-45db55242ce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:54 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-0430d03b-5c4f-42bf-9a66-d46a9345dcf4 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Deleted volume successfully. Apr 27 10:18:54 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-c42dca9a-5ca2-4d49-9d68-d7b9763d326b tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Created volume successfully. Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-0430d03b-5c4f-42bf-9a66-d46a9345dcf4 tempest-CreateVolumesFromSnapshotTest-1571585239 None] Lock "cinder-1b9b990b-228b-4169-8a3b-4dba9cfa4529-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:54 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-70c0afbf-c632-4aab-8543-98a5ad291786 tempest-CinderUnicodeTest-290536026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-224b4517-d29d-414d-823f-3b113d379a03" returned: 0 in 0.503s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-70c0afbf-c632-4aab-8543-98a5ad291786 tempest-CinderUnicodeTest-290536026 None] Lock "cinder-quobyte-224b4517-d29d-414d-823f-3b113d379a03" released by "delete_volume" :: held 1.124s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:54 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-70c0afbf-c632-4aab-8543-98a5ad291786 tempest-CinderUnicodeTest-290536026 None] Created reservations ['96edae04-2b58-4c72-bf89-5bb4239a91dd', 'a72952ca-b507-4a92-afc2-83d814238052', '0ecd0d81-c73e-4fe3-8169-9f3caf910963', '2f5ed609-bc83-4fb7-9041-b6c0a09d4879'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-70c0afbf-c632-4aab-8543-98a5ad291786 tempest-CinderUnicodeTest-290536026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-70c0afbf-c632-4aab-8543-98a5ad291786 tempest-CinderUnicodeTest-290536026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-70c0afbf-c632-4aab-8543-98a5ad291786 tempest-CinderUnicodeTest-290536026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-70c0afbf-c632-4aab-8543-98a5ad291786 tempest-CinderUnicodeTest-290536026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-70c0afbf-c632-4aab-8543-98a5ad291786 tempest-CinderUnicodeTest-290536026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-70c0afbf-c632-4aab-8543-98a5ad291786 tempest-CinderUnicodeTest-290536026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:55 devstack sudo[90847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:18:55 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:55 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444 1073741824" returned: 0 in 0.698s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:55 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444 Apr 27 10:18:55 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:55 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-70c0afbf-c632-4aab-8543-98a5ad291786 tempest-CinderUnicodeTest-290536026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.542s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-70c0afbf-c632-4aab-8543-98a5ad291786 tempest-CinderUnicodeTest-290536026 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:18:55 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-70c0afbf-c632-4aab-8543-98a5ad291786 tempest-CinderUnicodeTest-290536026 None] Deleted volume successfully. Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-70c0afbf-c632-4aab-8543-98a5ad291786 tempest-CinderUnicodeTest-290536026 None] Lock "cinder-224b4517-d29d-414d-823f-3b113d379a03-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:55 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444" returned: 0 in 0.576s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.450s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1224189120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c16469-cd04-4748-9a1d-2012fede7a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e9f05089fa4202b801bb8d71bdce80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:50Z,use_quota=True,user_id='b401138a80c14f87a07dfa920c8ad7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Creating volume 12c16469-cd04-4748-9a1d-2012fede7a8f {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:18:55 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-12c16469-cd04-4748-9a1d-2012fede7a8f 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:55 devstack sudo[90853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-12c16469-cd04-4748-9a1d-2012fede7a8f 1073741824 Apr 27 10:18:55 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777d63f7-3979-4f24-92e0-a74ad0a0c8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69638d6c-fc70-43a5-93f5-6a4daa430444', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4010c7b-c4e9-447d-a5ba-6cbc1a339c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:55 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Volume volume-69638d6c-fc70-43a5-93f5-6a4daa430444 (69638d6c-fc70-43a5-93f5-6a4daa430444): created successfully Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4010c7b-c4e9-447d-a5ba-6cbc1a339c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:55 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Flow 'volume_create_manager' (8e379d30-5aff-41a7-b391-5ad91be48195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:55 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-fed99820-6c76-4adc-84f4-4990f55ed7d2 tempest-VolumeDependencyTests-731872209 None] Created volume successfully. Apr 27 10:18:56 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-12c16469-cd04-4748-9a1d-2012fede7a8f 1073741824" returned: 0 in 0.895s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:56 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-12c16469-cd04-4748-9a1d-2012fede7a8f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:56 devstack sudo[90858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-12c16469-cd04-4748-9a1d-2012fede7a8f Apr 27 10:18:56 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Flow 'volume_create_manager' (878dbdf2-e980-42b7-b224-f88f4b21c192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e432995-e634-4743-af19-7c50a63d6131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e432995-e634-4743-af19-7c50a63d6131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1105069762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57babe98-41e2-4a45-9321-b4fdeb9f6683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='958b8fcd112b4e538e321c80389b7a02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=69638d6c-fc70-43a5-93f5-6a4daa430444,status='creating',terminated_at=None,updated_at=2026-04-27T08:18:57Z,use_quota=True,user_id='d84b90f4c6a749a18799b88589605c82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c950529d-5915-466b-9a1b-bf6a86ab5fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c950529d-5915-466b-9a1b-bf6a86ab5fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ba100f-67a0-45a6-b2bb-a9a9a8b2ac35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ba100f-67a0-45a6-b2bb-a9a9a8b2ac35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '57babe98-41e2-4a45-9321-b4fdeb9f6683', 'volume_name': 'volume-57babe98-41e2-4a45-9321-b4fdeb9f6683', 'volume_size': 1, 'source_volid': '69638d6c-fc70-43a5-93f5-6a4daa430444', 'source_volstatus': 'available'}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7afe2fda-f9c0-43e8-97e5-d583c7fda0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7afe2fda-f9c0-43e8-97e5-d583c7fda0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c0ea504-23c8-435b-b2a7-cb9c71971c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:57 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Volume 57babe98-41e2-4a45-9321-b4fdeb9f6683: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-57babe98-41e2-4a45-9321-b4fdeb9f6683', 'volume_size': 1, 'source_volid': '69638d6c-fc70-43a5-93f5-6a4daa430444', 'source_volstatus': 'available'} Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:57 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-12c16469-cd04-4748-9a1d-2012fede7a8f" returned: 0 in 0.507s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.108s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:57 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Cloning volume 69638d6c-fc70-43a5-93f5-6a4daa430444 to volume 57babe98-41e2-4a45-9321-b4fdeb9f6683 Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391ae394-2dc1-44bd-a1c1-f424c326e97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12c16469-cd04-4748-9a1d-2012fede7a8f', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26909fe4-2709-47ba-99f6-bc65534e58d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:18:57 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Volume volume-12c16469-cd04-4748-9a1d-2012fede7a8f (12c16469-cd04-4748-9a1d-2012fede7a8f): created successfully Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26909fe4-2709-47ba-99f6-bc65534e58d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Flow 'volume_create_manager' (be98eeb1-5cd4-42f0-9dc4-6d105e4ca438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Creating offline snapshot d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb of volume 69638d6c-fc70-43a5-93f5-6a4daa430444 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:18:57 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-2e93c25d-34ef-4a60-9b74-b3bc27f1274a tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Created volume successfully. Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[481d4c4b-3c39-41ff-a931-e61dced72cc7]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:57 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444 Apr 27 10:18:57 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e7d96fc5-23e6-4501-82fb-ddd86b4a0b80 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "cinder-12c16469-cd04-4748-9a1d-2012fede7a8f-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e7d96fc5-23e6-4501-82fb-ddd86b4a0b80 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "cinder-12c16469-cd04-4748-9a1d-2012fede7a8f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e7d96fc5-23e6-4501-82fb-ddd86b4a0b80 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "cinder-quobyte-12c16469-cd04-4748-9a1d-2012fede7a8f" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e7d96fc5-23e6-4501-82fb-ddd86b4a0b80 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "cinder-quobyte-12c16469-cd04-4748-9a1d-2012fede7a8f" acquired by "delete_volume" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ab5e99-e2bf-403f-b24d-0e9afce412c1]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e7d96fc5-23e6-4501-82fb-ddd86b4a0b80 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-12c16469-cd04-4748-9a1d-2012fede7a8f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:57 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444" returned: 0 in 0.640s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:57 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:58 devstack sudo[90867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb 1G Apr 27 10:18:58 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:58 devstack sudo[90866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-12c16469-cd04-4748-9a1d-2012fede7a8f Apr 27 10:18:58 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:58 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e7d96fc5-23e6-4501-82fb-ddd86b4a0b80 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-12c16469-cd04-4748-9a1d-2012fede7a8f" returned: 0 in 0.708s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e7d96fc5-23e6-4501-82fb-ddd86b4a0b80 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-12c16469-cd04-4748-9a1d-2012fede7a8f {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:58 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-12c16469-cd04-4748-9a1d-2012fede7a8f Apr 27 10:18:58 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:58 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb 1G" returned: 0 in 0.702s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:58 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69638d6c-fc70-43a5-93f5-6a4daa430444 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:58 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69638d6c-fc70-43a5-93f5-6a4daa430444 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb Apr 27 10:18:58 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:59 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e7d96fc5-23e6-4501-82fb-ddd86b4a0b80 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-12c16469-cd04-4748-9a1d-2012fede7a8f" returned: 0 in 0.562s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:59 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e7d96fc5-23e6-4501-82fb-ddd86b4a0b80 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "cinder-quobyte-12c16469-cd04-4748-9a1d-2012fede7a8f" released by "delete_volume" :: held 1.309s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:18:59 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:59 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-e7d96fc5-23e6-4501-82fb-ddd86b4a0b80 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Created reservations ['3ef10c47-c1e9-435a-a1da-4e12dbec2b49', '62b31b4b-d268-4db2-812a-8aefbb41edb9', 'bca2a6c7-6ae5-4ff5-a044-34516b9d7d15', '1a814074-1930-4295-906e-3f9a63641ae8'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:18:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69638d6c-fc70-43a5-93f5-6a4daa430444 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb" returned: 0 in 0.606s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:59 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb is being set with open permissions: ugo+rw Apr 27 10:18:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:59 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb Apr 27 10:18:59 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e7d96fc5-23e6-4501-82fb-ddd86b4a0b80 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:18:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e7d96fc5-23e6-4501-82fb-ddd86b4a0b80 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:18:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e7d96fc5-23e6-4501-82fb-ddd86b4a0b80 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:18:59 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e7d96fc5-23e6-4501-82fb-ddd86b4a0b80 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:18:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e7d96fc5-23e6-4501-82fb-ddd86b4a0b80 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:18:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e7d96fc5-23e6-4501-82fb-ddd86b4a0b80 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:59 devstack sudo[90921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:18:59 devstack sudo[90921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:59 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb" returned: 0 in 0.520s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:18:59 devstack sudo[90925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.info Apr 27 10:18:59 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:18:59 devstack sudo[90921]: pam_unix(sudo:session): session closed for user root Apr 27 10:18:59 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e7d96fc5-23e6-4501-82fb-ddd86b4a0b80 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.537s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:18:59 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-e7d96fc5-23e6-4501-82fb-ddd86b4a0b80 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:18:59 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-e7d96fc5-23e6-4501-82fb-ddd86b4a0b80 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Deleted volume successfully. Apr 27 10:18:59 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e7d96fc5-23e6-4501-82fb-ddd86b4a0b80 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "cinder-12c16469-cd04-4748-9a1d-2012fede7a8f-delete_volume" released by "delete_volume" :: held 2.108s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1b04aec0-e1c0-4438-bc11-52aeb5a05680 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "cinder-a786f1b0-05e4-4299-a7ec-242b07b65bb2-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1b04aec0-e1c0-4438-bc11-52aeb5a05680 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "cinder-a786f1b0-05e4-4299-a7ec-242b07b65bb2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1b04aec0-e1c0-4438-bc11-52aeb5a05680 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "cinder-quobyte-a786f1b0-05e4-4299-a7ec-242b07b65bb2" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1b04aec0-e1c0-4438-bc11-52aeb5a05680 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "cinder-quobyte-a786f1b0-05e4-4299-a7ec-242b07b65bb2" acquired by "delete_volume" :: waited 0.015s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:00 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ffefaf-7365-4eca-91f2-03ac31efc9bd]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:19:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1b04aec0-e1c0-4438-bc11-52aeb5a05680 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a786f1b0-05e4-4299-a7ec-242b07b65bb2 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:00 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a786f1b0-05e4-4299-a7ec-242b07b65bb2 Apr 27 10:19:00 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:00 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.info" returned: 0 in 0.528s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:00 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.info is being set with open permissions: ugo+rw Apr 27 10:19:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:00 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.info Apr 27 10:19:00 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:00 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1b04aec0-e1c0-4438-bc11-52aeb5a05680 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a786f1b0-05e4-4299-a7ec-242b07b65bb2" returned: 0 in 0.569s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1b04aec0-e1c0-4438-bc11-52aeb5a05680 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a786f1b0-05e4-4299-a7ec-242b07b65bb2 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:00 devstack sudo[90935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a786f1b0-05e4-4299-a7ec-242b07b65bb2 Apr 27 10:19:00 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:00 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.info" returned: 0 in 0.528s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Acquiring lock "cinder-quobyte-57babe98-41e2-4a45-9321-b4fdeb9f6683" by "_copy_volume_from_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:00 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Lock "cinder-quobyte-57babe98-41e2-4a45-9321-b4fdeb9f6683" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:00 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] snapshot: d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb, volume: 57babe98-41e2-4a45-9321-b4fdeb9f6683, {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 27 10:19:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:19:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:19:00 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:19:00 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:19:00 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:19:01 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[344396df-211b-44e7-9966-6ae124f2739b]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:19:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:01 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb Apr 27 10:19:01 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:01 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1b04aec0-e1c0-4438-bc11-52aeb5a05680 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-a786f1b0-05e4-4299-a7ec-242b07b65bb2" returned: 0 in 0.552s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:01 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1b04aec0-e1c0-4438-bc11-52aeb5a05680 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "cinder-quobyte-a786f1b0-05e4-4299-a7ec-242b07b65bb2" released by "delete_volume" :: held 1.170s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:01 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-1b04aec0-e1c0-4438-bc11-52aeb5a05680 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Created reservations ['3e37d700-b0d8-4050-bb01-00340224ea8c', 'cf2138cd-7b4e-45f9-974c-bb3aa0e11685', '12dd6cf1-60e0-4e52-8a6c-09a7ee95ad50', '63c77758-bdd7-444b-a90f-b5f56a18a602'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:19:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1b04aec0-e1c0-4438-bc11-52aeb5a05680 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:19:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1b04aec0-e1c0-4438-bc11-52aeb5a05680 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:19:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-1b04aec0-e1c0-4438-bc11-52aeb5a05680 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:19:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-1b04aec0-e1c0-4438-bc11-52aeb5a05680 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:19:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1b04aec0-e1c0-4438-bc11-52aeb5a05680 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:19:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1b04aec0-e1c0-4438-bc11-52aeb5a05680 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:01 devstack sudo[90942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:19:01 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:01 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb" returned: 0 in 0.657s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69638d6c-fc70-43a5-93f5-6a4daa430444(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:19:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444 {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 27 10:19:01 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Creating direct copy from snapshot {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 27 10:19:01 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9ca4a1-c08a-4dfd-845b-f07e866a5dc2]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:19:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:01 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444 Apr 27 10:19:01 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:01 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:01 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1b04aec0-e1c0-4438-bc11-52aeb5a05680 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.491s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:01 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-1b04aec0-e1c0-4438-bc11-52aeb5a05680 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:19:02 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-1b04aec0-e1c0-4438-bc11-52aeb5a05680 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Deleted volume successfully. Apr 27 10:19:02 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1b04aec0-e1c0-4438-bc11-52aeb5a05680 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "cinder-a786f1b0-05e4-4299-a7ec-242b07b65bb2-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:02 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444" returned: 0 in 0.603s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:02 devstack cinder-volume[81350]: DEBUG cinder.utils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Path /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57babe98-41e2-4a45-9321-b4fdeb9f6683 not found in is_blk_device check {{(pid=81350) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 27 10:19:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57babe98-41e2-4a45-9321-b4fdeb9f6683 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:02 devstack sudo[90952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57babe98-41e2-4a45-9321-b4fdeb9f6683 Apr 27 10:19:02 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:02 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a6835241-fdde-4f5f-b3b6-e01866820cb7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "cinder-6271af9f-66af-4259-bfdb-0722569ce9cd-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:02 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a6835241-fdde-4f5f-b3b6-e01866820cb7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "cinder-6271af9f-66af-4259-bfdb-0722569ce9cd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:02 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a6835241-fdde-4f5f-b3b6-e01866820cb7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "cinder-quobyte-6271af9f-66af-4259-bfdb-0722569ce9cd" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:02 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a6835241-fdde-4f5f-b3b6-e01866820cb7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "cinder-quobyte-6271af9f-66af-4259-bfdb-0722569ce9cd" acquired by "delete_volume" :: waited 0.022s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:02 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee16fd9-e2c0-4e34-9acc-150b0d68b668]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:19:02 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a6835241-fdde-4f5f-b3b6-e01866820cb7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6271af9f-66af-4259-bfdb-0722569ce9cd {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:02 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6271af9f-66af-4259-bfdb-0722569ce9cd Apr 27 10:19:02 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:03 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a6835241-fdde-4f5f-b3b6-e01866820cb7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6271af9f-66af-4259-bfdb-0722569ce9cd" returned: 0 in 0.858s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:03 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a6835241-fdde-4f5f-b3b6-e01866820cb7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6271af9f-66af-4259-bfdb-0722569ce9cd {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:03 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6271af9f-66af-4259-bfdb-0722569ce9cd Apr 27 10:19:03 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:04 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:04 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a6835241-fdde-4f5f-b3b6-e01866820cb7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-6271af9f-66af-4259-bfdb-0722569ce9cd" returned: 0 in 1.571s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:04 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a6835241-fdde-4f5f-b3b6-e01866820cb7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "cinder-quobyte-6271af9f-66af-4259-bfdb-0722569ce9cd" released by "delete_volume" :: held 2.494s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:05 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-a6835241-fdde-4f5f-b3b6-e01866820cb7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Created reservations ['0b517714-c08e-48d9-bf90-99def686be2b', 'aa1a48df-e1e5-443f-9d2e-11816d49c3dc', 'd1cfa61a-ddba-4787-9f55-d5da84df1e5d', 'b2e72bec-e07e-40fb-b74d-5b9e0993223f'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:19:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-a6835241-fdde-4f5f-b3b6-e01866820cb7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:19:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-a6835241-fdde-4f5f-b3b6-e01866820cb7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:19:05 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-a6835241-fdde-4f5f-b3b6-e01866820cb7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:19:05 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-a6835241-fdde-4f5f-b3b6-e01866820cb7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:19:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-a6835241-fdde-4f5f-b3b6-e01866820cb7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:19:05 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a6835241-fdde-4f5f-b3b6-e01866820cb7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:05 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:19:05 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:05 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1cdd7057-d43e-4ef3-b56f-ba8e30e2c664 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "cinder-d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:05 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1cdd7057-d43e-4ef3-b56f-ba8e30e2c664 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "cinder-d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1cdd7057-d43e-4ef3-b56f-ba8e30e2c664 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "cinder-quobyte-d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1cdd7057-d43e-4ef3-b56f-ba8e30e2c664 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "cinder-quobyte-d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de" acquired by "delete_volume" :: waited 0.019s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:06 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a259be44-d684-4a86-81b1-97c0384e476e]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:19:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1cdd7057-d43e-4ef3-b56f-ba8e30e2c664 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:06 devstack sudo[90975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de Apr 27 10:19:06 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:06 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:06 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a6835241-fdde-4f5f-b3b6-e01866820cb7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 1.374s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:06 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-a6835241-fdde-4f5f-b3b6-e01866820cb7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:19:06 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-a6835241-fdde-4f5f-b3b6-e01866820cb7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Deleted volume successfully. Apr 27 10:19:06 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:SELECT=153,cinder:UPDATE=240,cinder:DELETE=18,cinder:INSERT=52 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:19:06 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a6835241-fdde-4f5f-b3b6-e01866820cb7 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "cinder-6271af9f-66af-4259-bfdb-0722569ce9cd-delete_volume" released by "delete_volume" :: held 4.379s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:07 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1cdd7057-d43e-4ef3-b56f-ba8e30e2c664 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de" returned: 0 in 1.513s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:07 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1cdd7057-d43e-4ef3-b56f-ba8e30e2c664 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:07 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de Apr 27 10:19:07 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:08 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57babe98-41e2-4a45-9321-b4fdeb9f6683" returned: 0 in 6.335s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:08 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a47256-8168-4bd8-9e20-9cf995fa5d90]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:19:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:08 devstack sudo[90984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444 Apr 27 10:19:08 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:08 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1cdd7057-d43e-4ef3-b56f-ba8e30e2c664 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de" returned: 0 in 1.074s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:08 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1cdd7057-d43e-4ef3-b56f-ba8e30e2c664 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "cinder-quobyte-d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de" released by "delete_volume" :: held 2.736s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:08 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:UPDATE=208,cinder:SELECT=172,cinder:INSERT=54,cinder:DELETE=24 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:19:08 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-1cdd7057-d43e-4ef3-b56f-ba8e30e2c664 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Created reservations ['e124862d-7d4c-42dd-b0fe-554059c0222a', '7e0f483c-d457-461e-8e46-cc547b29986e', '3a9f5e29-aa7d-4cc7-963d-0d128a5d82e0', '6d0f2fc5-4536-4b14-b8e1-ebae573761b8'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:19:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1cdd7057-d43e-4ef3-b56f-ba8e30e2c664 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:19:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1cdd7057-d43e-4ef3-b56f-ba8e30e2c664 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:19:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-1cdd7057-d43e-4ef3-b56f-ba8e30e2c664 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:19:08 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-1cdd7057-d43e-4ef3-b56f-ba8e30e2c664 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:19:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-1cdd7057-d43e-4ef3-b56f-ba8e30e2c664 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:19:08 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1cdd7057-d43e-4ef3-b56f-ba8e30e2c664 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:08 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:19:08 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:09 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-1cdd7057-d43e-4ef3-b56f-ba8e30e2c664 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.589s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:09 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-1cdd7057-d43e-4ef3-b56f-ba8e30e2c664 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:19:09 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-1cdd7057-d43e-4ef3-b56f-ba8e30e2c664 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Deleted volume successfully. Apr 27 10:19:09 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444" returned: 0 in 0.897s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:09 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Image conversion details: src /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444, size 1024.00 MB, duration 6.34 sec, destination /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57babe98-41e2-4a45-9321-b4fdeb9f6683 {{(pid=81350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 10:19:09 devstack cinder-volume[81350]: INFO cinder.image.image_utils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Converted 1024.00 MB image at 161.59 MB/s Apr 27 10:19:09 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57babe98-41e2-4a45-9321-b4fdeb9f6683 is being set with open permissions: ugo+rw Apr 27 10:19:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57babe98-41e2-4a45-9321-b4fdeb9f6683 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:09 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-1cdd7057-d43e-4ef3-b56f-ba8e30e2c664 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "cinder-d9da49d0-c9fd-4ca0-b86a-f102f0f1a5de-delete_volume" released by "delete_volume" :: held 3.604s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:09 devstack sudo[90992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57babe98-41e2-4a45-9321-b4fdeb9f6683 Apr 27 10:19:09 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:09 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-38e3958b-b5a9-4f6d-86c4-3e27d7bcfc3f tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "cinder-37f69c7d-a069-41cb-b24a-517978f97be9-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:09 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-38e3958b-b5a9-4f6d-86c4-3e27d7bcfc3f tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "cinder-37f69c7d-a069-41cb-b24a-517978f97be9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:09 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-38e3958b-b5a9-4f6d-86c4-3e27d7bcfc3f tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "cinder-quobyte-37f69c7d-a069-41cb-b24a-517978f97be9" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:09 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-38e3958b-b5a9-4f6d-86c4-3e27d7bcfc3f tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "cinder-quobyte-37f69c7d-a069-41cb-b24a-517978f97be9" acquired by "delete_volume" :: waited 0.017s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:09 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7a0d2d-b964-4fd4-aa11-80940f7ec1f2]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:19:09 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-38e3958b-b5a9-4f6d-86c4-3e27d7bcfc3f tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-37f69c7d-a069-41cb-b24a-517978f97be9 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:09 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-37f69c7d-a069-41cb-b24a-517978f97be9 Apr 27 10:19:09 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:10 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57babe98-41e2-4a45-9321-b4fdeb9f6683" returned: 0 in 0.528s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Lock "cinder-quobyte-57babe98-41e2-4a45-9321-b4fdeb9f6683" released by "_copy_volume_from_snapshot" :: held 9.115s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Acquiring lock "cinder-quobyte-d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Lock "cinder-quobyte-d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:10 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Deleting offline snapshot d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb of volume 69638d6c-fc70-43a5-93f5-6a4daa430444 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:19:10 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] snapshot_file for this snap is: volume-69638d6c-fc70-43a5-93f5-6a4daa430444.d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:19:10 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac62440-291a-4e9e-9034-2fe67793198c]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:19:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:10 devstack sudo[90997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb Apr 27 10:19:10 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:10 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-38e3958b-b5a9-4f6d-86c4-3e27d7bcfc3f tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-37f69c7d-a069-41cb-b24a-517978f97be9" returned: 0 in 0.605s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-38e3958b-b5a9-4f6d-86c4-3e27d7bcfc3f tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-37f69c7d-a069-41cb-b24a-517978f97be9 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:10 devstack sudo[91002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-37f69c7d-a069-41cb-b24a-517978f97be9 Apr 27 10:19:10 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:10 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb" returned: 0 in 0.625s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:10 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69638d6c-fc70-43a5-93f5-6a4daa430444(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:19:10 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-38e3958b-b5a9-4f6d-86c4-3e27d7bcfc3f tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-37f69c7d-a069-41cb-b24a-517978f97be9" returned: 0 in 0.481s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:10 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab21895-6527-45cf-a425-0bf1f69e4d1c]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:19:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:10 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-38e3958b-b5a9-4f6d-86c4-3e27d7bcfc3f tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "cinder-quobyte-37f69c7d-a069-41cb-b24a-517978f97be9" released by "delete_volume" :: held 1.140s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:10 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-38e3958b-b5a9-4f6d-86c4-3e27d7bcfc3f tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Created reservations ['39cdac49-bc8d-4535-b5f5-56320fae4059', '166ed372-5a45-4f0d-adf4-e2c135f40273', 'c7e08b78-c83c-4324-aee8-f74debe23992', '737fcfec-e5f3-4647-95dd-35fba12897b2'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:19:10 devstack sudo[91008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444 Apr 27 10:19:10 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-38e3958b-b5a9-4f6d-86c4-3e27d7bcfc3f tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:19:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-38e3958b-b5a9-4f6d-86c4-3e27d7bcfc3f tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:19:10 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-38e3958b-b5a9-4f6d-86c4-3e27d7bcfc3f tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:19:10 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-38e3958b-b5a9-4f6d-86c4-3e27d7bcfc3f tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:19:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-38e3958b-b5a9-4f6d-86c4-3e27d7bcfc3f tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:19:10 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-38e3958b-b5a9-4f6d-86c4-3e27d7bcfc3f tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:11 devstack sudo[91010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:19:11 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:11 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:11 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444" returned: 0 in 0.735s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:11 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-38e3958b-b5a9-4f6d-86c4-3e27d7bcfc3f tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.586s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:11 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-38e3958b-b5a9-4f6d-86c4-3e27d7bcfc3f tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:19:11 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-38e3958b-b5a9-4f6d-86c4-3e27d7bcfc3f tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Deleted volume successfully. Apr 27 10:19:11 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb Apr 27 10:19:11 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-38e3958b-b5a9-4f6d-86c4-3e27d7bcfc3f tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "cinder-37f69c7d-a069-41cb-b24a-517978f97be9-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bf357a0d-26fc-4262-9652-773856f3a293 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "cinder-57ae8210-befd-45da-9ab9-ca922664b06a-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bf357a0d-26fc-4262-9652-773856f3a293 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "cinder-57ae8210-befd-45da-9ab9-ca922664b06a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bf357a0d-26fc-4262-9652-773856f3a293 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "cinder-quobyte-57ae8210-befd-45da-9ab9-ca922664b06a" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:11 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bf357a0d-26fc-4262-9652-773856f3a293 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "cinder-quobyte-57ae8210-befd-45da-9ab9-ca922664b06a" acquired by "delete_volume" :: waited 0.020s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:12 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba41537-30f8-40a6-a054-7a380f0b2a10]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:19:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bf357a0d-26fc-4262-9652-773856f3a293 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57ae8210-befd-45da-9ab9-ca922664b06a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:12 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57ae8210-befd-45da-9ab9-ca922664b06a Apr 27 10:19:12 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:12 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb" returned: 0 in 0.665s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:12 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb Apr 27 10:19:12 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:12 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bf357a0d-26fc-4262-9652-773856f3a293 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57ae8210-befd-45da-9ab9-ca922664b06a" returned: 0 in 0.659s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bf357a0d-26fc-4262-9652-773856f3a293 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57ae8210-befd-45da-9ab9-ca922664b06a {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:12 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57ae8210-befd-45da-9ab9-ca922664b06a Apr 27 10:19:12 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:12 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444.d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb" returned: 0 in 0.536s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:12 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Lock "cinder-quobyte-d2f50bf2-95ac-4098-902b-9bd9c5bfc5bb" released by "_delete_snapshot" :: held 2.679s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:12 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.572s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:19:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c0ea504-23c8-435b-b2a7-cb9c71971c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57babe98-41e2-4a45-9321-b4fdeb9f6683', 'volume_size': 1, 'source_volid': '69638d6c-fc70-43a5-93f5-6a4daa430444', 'source_volstatus': 'available'}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:19:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d4da50-945b-4284-89ef-bf52f033ca24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:19:12 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Volume volume-57babe98-41e2-4a45-9321-b4fdeb9f6683 (57babe98-41e2-4a45-9321-b4fdeb9f6683): created successfully Apr 27 10:19:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d4da50-945b-4284-89ef-bf52f033ca24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:19:12 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Flow 'volume_create_manager' (878dbdf2-e980-42b7-b224-f88f4b21c192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:19:12 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-7fc29a5b-f2a3-4749-8530-2f6765116848 tempest-VolumeDependencyTests-731872209 None] Created volume successfully. Apr 27 10:19:13 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bf357a0d-26fc-4262-9652-773856f3a293 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57ae8210-befd-45da-9ab9-ca922664b06a" returned: 0 in 0.479s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bf357a0d-26fc-4262-9652-773856f3a293 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "cinder-quobyte-57ae8210-befd-45da-9ab9-ca922664b06a" released by "delete_volume" :: held 1.176s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:13 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-bf357a0d-26fc-4262-9652-773856f3a293 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Created reservations ['dbd13b04-5a8a-4cee-817c-138cd78c1d0f', '61d28555-4ce4-4cf7-8d65-fc4de249ace6', '79dc7bb9-9409-4e98-9350-0479287e1d5a', '660dd9de-73b5-4a7c-9b2c-61a727344c84'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:19:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bf357a0d-26fc-4262-9652-773856f3a293 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:19:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bf357a0d-26fc-4262-9652-773856f3a293 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:19:13 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-bf357a0d-26fc-4262-9652-773856f3a293 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:19:13 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-bf357a0d-26fc-4262-9652-773856f3a293 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:19:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-bf357a0d-26fc-4262-9652-773856f3a293 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:19:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bf357a0d-26fc-4262-9652-773856f3a293 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:13 devstack sudo[91032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:19:13 devstack sudo[91032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a73d3a36-0cc4-48d4-bcc2-6dc3fdd89f29 tempest-VolumeDependencyTests-731872209 None] Acquiring lock "cinder-69638d6c-fc70-43a5-93f5-6a4daa430444-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a73d3a36-0cc4-48d4-bcc2-6dc3fdd89f29 tempest-VolumeDependencyTests-731872209 None] Lock "cinder-69638d6c-fc70-43a5-93f5-6a4daa430444-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a73d3a36-0cc4-48d4-bcc2-6dc3fdd89f29 tempest-VolumeDependencyTests-731872209 None] Acquiring lock "cinder-quobyte-69638d6c-fc70-43a5-93f5-6a4daa430444" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a73d3a36-0cc4-48d4-bcc2-6dc3fdd89f29 tempest-VolumeDependencyTests-731872209 None] Lock "cinder-quobyte-69638d6c-fc70-43a5-93f5-6a4daa430444" acquired by "delete_volume" :: waited 0.014s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:13 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8301af5-00aa-4703-b38d-249445681b9f]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:19:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a73d3a36-0cc4-48d4-bcc2-6dc3fdd89f29 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:13 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444 Apr 27 10:19:13 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:13 devstack sudo[91032]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:13 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-bf357a0d-26fc-4262-9652-773856f3a293 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.538s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:13 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-bf357a0d-26fc-4262-9652-773856f3a293 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:19:13 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-bf357a0d-26fc-4262-9652-773856f3a293 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Deleted volume successfully. Apr 27 10:19:13 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-bf357a0d-26fc-4262-9652-773856f3a293 tempest-CreateVolumesFromSourceVolumeTest-489978037 None] Lock "cinder-57ae8210-befd-45da-9ab9-ca922664b06a-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:14 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a73d3a36-0cc4-48d4-bcc2-6dc3fdd89f29 tempest-VolumeDependencyTests-731872209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444" returned: 0 in 0.593s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a73d3a36-0cc4-48d4-bcc2-6dc3fdd89f29 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:14 devstack sudo[91040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444 Apr 27 10:19:14 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:14 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:14 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a73d3a36-0cc4-48d4-bcc2-6dc3fdd89f29 tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-69638d6c-fc70-43a5-93f5-6a4daa430444" returned: 0 in 0.574s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:14 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a73d3a36-0cc4-48d4-bcc2-6dc3fdd89f29 tempest-VolumeDependencyTests-731872209 None] Lock "cinder-quobyte-69638d6c-fc70-43a5-93f5-6a4daa430444" released by "delete_volume" :: held 1.236s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:14 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-a73d3a36-0cc4-48d4-bcc2-6dc3fdd89f29 tempest-VolumeDependencyTests-731872209 None] Created reservations ['871abb2e-13c1-4d45-a4bf-25f8e9ca17e4', 'bbf52271-dfe2-479e-8766-53e83f76edc9', 'bbf747a7-6ade-41a4-97c7-9b89e94fb63c', '9fdaf0b9-49cd-40e1-b653-141d086eb49f'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:19:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-a73d3a36-0cc4-48d4-bcc2-6dc3fdd89f29 tempest-VolumeDependencyTests-731872209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:19:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-a73d3a36-0cc4-48d4-bcc2-6dc3fdd89f29 tempest-VolumeDependencyTests-731872209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:19:15 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-a73d3a36-0cc4-48d4-bcc2-6dc3fdd89f29 tempest-VolumeDependencyTests-731872209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:19:15 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-a73d3a36-0cc4-48d4-bcc2-6dc3fdd89f29 tempest-VolumeDependencyTests-731872209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:19:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-a73d3a36-0cc4-48d4-bcc2-6dc3fdd89f29 tempest-VolumeDependencyTests-731872209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:19:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a73d3a36-0cc4-48d4-bcc2-6dc3fdd89f29 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:15 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:19:15 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:15 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:15 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-a73d3a36-0cc4-48d4-bcc2-6dc3fdd89f29 tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.618s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:15 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-a73d3a36-0cc4-48d4-bcc2-6dc3fdd89f29 tempest-VolumeDependencyTests-731872209 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:19:15 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-a73d3a36-0cc4-48d4-bcc2-6dc3fdd89f29 tempest-VolumeDependencyTests-731872209 None] Deleted volume successfully. Apr 27 10:19:15 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-a73d3a36-0cc4-48d4-bcc2-6dc3fdd89f29 tempest-VolumeDependencyTests-731872209 None] Lock "cinder-69638d6c-fc70-43a5-93f5-6a4daa430444-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:15 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-72436143-71cc-4822-b163-161c1b9f5ab3 tempest-VolumeDependencyTests-731872209 None] Acquiring lock "cinder-57babe98-41e2-4a45-9321-b4fdeb9f6683-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:15 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-72436143-71cc-4822-b163-161c1b9f5ab3 tempest-VolumeDependencyTests-731872209 None] Lock "cinder-57babe98-41e2-4a45-9321-b4fdeb9f6683-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:15 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-72436143-71cc-4822-b163-161c1b9f5ab3 tempest-VolumeDependencyTests-731872209 None] Acquiring lock "cinder-quobyte-57babe98-41e2-4a45-9321-b4fdeb9f6683" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:15 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-72436143-71cc-4822-b163-161c1b9f5ab3 tempest-VolumeDependencyTests-731872209 None] Lock "cinder-quobyte-57babe98-41e2-4a45-9321-b4fdeb9f6683" acquired by "delete_volume" :: waited 0.033s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:16 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5679b5de-53e0-4e51-bf84-53fcd9be2eb0]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:19:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-72436143-71cc-4822-b163-161c1b9f5ab3 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57babe98-41e2-4a45-9321-b4fdeb9f6683 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:16 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57babe98-41e2-4a45-9321-b4fdeb9f6683 Apr 27 10:19:16 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:16 devstack cinder-volume[81350]: DEBUG oslo_service.periodic_task [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81350) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 10:19:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:19:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:19:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:19:16 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:19:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:19:16 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:16 devstack sudo[91055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:19:16 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:17 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-72436143-71cc-4822-b163-161c1b9f5ab3 tempest-VolumeDependencyTests-731872209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57babe98-41e2-4a45-9321-b4fdeb9f6683" returned: 0 in 1.081s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-72436143-71cc-4822-b163-161c1b9f5ab3 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57babe98-41e2-4a45-9321-b4fdeb9f6683 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:17 devstack sudo[91061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57babe98-41e2-4a45-9321-b4fdeb9f6683 Apr 27 10:19:17 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:17 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.594s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:17 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-3b7195ed-bbcb-4557-9cb8-94840edc4025 None None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:19:17 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-72436143-71cc-4822-b163-161c1b9f5ab3 tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-57babe98-41e2-4a45-9321-b4fdeb9f6683" returned: 0 in 0.479s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:17 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-72436143-71cc-4822-b163-161c1b9f5ab3 tempest-VolumeDependencyTests-731872209 None] Lock "cinder-quobyte-57babe98-41e2-4a45-9321-b4fdeb9f6683" released by "delete_volume" :: held 1.625s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:17 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-72436143-71cc-4822-b163-161c1b9f5ab3 tempest-VolumeDependencyTests-731872209 None] Created reservations ['3b78c6f5-0c0c-4e2b-8cc7-83db4197b6ec', '5ec6fe47-5cd2-4510-ba5d-91aff6befffb', '331c01ea-4872-4fdb-85d0-73821cb56f77', '190b3371-c8fc-4137-aa8c-f062f6eac85c'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:19:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-72436143-71cc-4822-b163-161c1b9f5ab3 tempest-VolumeDependencyTests-731872209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:19:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-72436143-71cc-4822-b163-161c1b9f5ab3 tempest-VolumeDependencyTests-731872209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:19:17 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-72436143-71cc-4822-b163-161c1b9f5ab3 tempest-VolumeDependencyTests-731872209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:19:17 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-72436143-71cc-4822-b163-161c1b9f5ab3 tempest-VolumeDependencyTests-731872209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:19:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-72436143-71cc-4822-b163-161c1b9f5ab3 tempest-VolumeDependencyTests-731872209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:19:17 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-72436143-71cc-4822-b163-161c1b9f5ab3 tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:17 devstack sudo[91065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:19:17 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:18 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5269f853-7cc1-4b38-a5b8-56a6b48bdf0e tempest-VolumeDependencyTests-731872209 None] Acquiring lock "cinder-0f1933d1-4640-4b5f-a06a-a05254e58fb1-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:18 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5269f853-7cc1-4b38-a5b8-56a6b48bdf0e tempest-VolumeDependencyTests-731872209 None] Lock "cinder-0f1933d1-4640-4b5f-a06a-a05254e58fb1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:18 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5269f853-7cc1-4b38-a5b8-56a6b48bdf0e tempest-VolumeDependencyTests-731872209 None] Acquiring lock "cinder-quobyte-0f1933d1-4640-4b5f-a06a-a05254e58fb1" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:18 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5269f853-7cc1-4b38-a5b8-56a6b48bdf0e tempest-VolumeDependencyTests-731872209 None] Lock "cinder-quobyte-0f1933d1-4640-4b5f-a06a-a05254e58fb1" acquired by "delete_volume" :: waited 0.022s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:18 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfce7dc-07bf-4ab4-973f-a954f7d13667]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:19:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5269f853-7cc1-4b38-a5b8-56a6b48bdf0e tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f1933d1-4640-4b5f-a06a-a05254e58fb1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:18 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f1933d1-4640-4b5f-a06a-a05254e58fb1 Apr 27 10:19:18 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:18 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:18 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-72436143-71cc-4822-b163-161c1b9f5ab3 tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.673s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:18 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-72436143-71cc-4822-b163-161c1b9f5ab3 tempest-VolumeDependencyTests-731872209 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:19:18 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-72436143-71cc-4822-b163-161c1b9f5ab3 tempest-VolumeDependencyTests-731872209 None] Deleted volume successfully. Apr 27 10:19:18 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-72436143-71cc-4822-b163-161c1b9f5ab3 tempest-VolumeDependencyTests-731872209 None] Lock "cinder-57babe98-41e2-4a45-9321-b4fdeb9f6683-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:19 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5269f853-7cc1-4b38-a5b8-56a6b48bdf0e tempest-VolumeDependencyTests-731872209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f1933d1-4640-4b5f-a06a-a05254e58fb1" returned: 0 in 0.717s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5269f853-7cc1-4b38-a5b8-56a6b48bdf0e tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f1933d1-4640-4b5f-a06a-a05254e58fb1 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:19 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f1933d1-4640-4b5f-a06a-a05254e58fb1 Apr 27 10:19:19 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:19 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5269f853-7cc1-4b38-a5b8-56a6b48bdf0e tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-0f1933d1-4640-4b5f-a06a-a05254e58fb1" returned: 0 in 0.511s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Flow 'volume_create_manager' (f5ec266e-76dd-434a-b51b-86dbba17307d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b33e40-fbb2-4404-8724-55a386b62c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5269f853-7cc1-4b38-a5b8-56a6b48bdf0e tempest-VolumeDependencyTests-731872209 None] Lock "cinder-quobyte-0f1933d1-4640-4b5f-a06a-a05254e58fb1" released by "delete_volume" :: held 1.301s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b33e40-fbb2-4404-8724-55a386b62c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-605406662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c40b60a5-de2a-4554-9e54-d9f7ad81e274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f45d07690bd942d08f81b8445cb9abf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:19:19Z,use_quota=True,user_id='d58458967a5748829bb23dd794083d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa67b89-c7dc-48ac-829c-5645558ca49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa67b89-c7dc-48ac-829c-5645558ca49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9f29a7-fc4c-4a75-bcda-88f961752aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9f29a7-fc4c-4a75-bcda-88f961752aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c40b60a5-de2a-4554-9e54-d9f7ad81e274', 'volume_name': 'volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4f8d31-77b8-4572-9772-6fd203502a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4f8d31-77b8-4572-9772-6fd203502a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb6ead3-d009-4b84-80fc-ef7c8bef7328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:19:19 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Volume c40b60a5-de2a-4554-9e54-d9f7ad81e274: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274', 'volume_size': 1} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-605406662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c40b60a5-de2a-4554-9e54-d9f7ad81e274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f45d07690bd942d08f81b8445cb9abf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:19:19Z,use_quota=True,user_id='d58458967a5748829bb23dd794083d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)}" {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Creating volume c40b60a5-de2a-4554-9e54-d9f7ad81e274 {{(pid=81350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:19:19 devstack cinder-volume[81350]: INFO cinder.volume.drivers.remotefs [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] casted to osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 1073741824 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:19 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 1073741824 Apr 27 10:19:19 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-5269f853-7cc1-4b38-a5b8-56a6b48bdf0e tempest-VolumeDependencyTests-731872209 None] Created reservations ['abe8fedf-747b-4d06-ac66-efea90f4016e', '38084d58-fe29-4ec6-806c-cccac704bcf5', '5895e23c-5cfb-41f2-a2e6-f3dd2a54f7bc', '6dfc2efc-9328-47c6-9632-22394522922a'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5269f853-7cc1-4b38-a5b8-56a6b48bdf0e tempest-VolumeDependencyTests-731872209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5269f853-7cc1-4b38-a5b8-56a6b48bdf0e tempest-VolumeDependencyTests-731872209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5269f853-7cc1-4b38-a5b8-56a6b48bdf0e tempest-VolumeDependencyTests-731872209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-5269f853-7cc1-4b38-a5b8-56a6b48bdf0e tempest-VolumeDependencyTests-731872209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-5269f853-7cc1-4b38-a5b8-56a6b48bdf0e tempest-VolumeDependencyTests-731872209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:19:19 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5269f853-7cc1-4b38-a5b8-56a6b48bdf0e tempest-VolumeDependencyTests-731872209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:19 devstack sudo[91078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:19:19 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:20 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-5269f853-7cc1-4b38-a5b8-56a6b48bdf0e tempest-VolumeDependencyTests-731872209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.456s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:20 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-5269f853-7cc1-4b38-a5b8-56a6b48bdf0e tempest-VolumeDependencyTests-731872209 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:19:20 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-5269f853-7cc1-4b38-a5b8-56a6b48bdf0e tempest-VolumeDependencyTests-731872209 None] Deleted volume successfully. Apr 27 10:19:20 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-5269f853-7cc1-4b38-a5b8-56a6b48bdf0e tempest-VolumeDependencyTests-731872209 None] Lock "cinder-0f1933d1-4640-4b5f-a06a-a05254e58fb1-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:20 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 1073741824" returned: 0 in 0.608s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:20 devstack sudo[91084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 Apr 27 10:19:20 devstack sudo[91084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:20 devstack sudo[91084]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274" returned: 0 in 0.473s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:20 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'} {{(pid=81350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 10:19:20 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:19:20 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb6ead3-d009-4b84-80fc-ef7c8bef7328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274', 'volume_size': 1}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:19:20 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345884d3-6752-49a2-88ea-717d7b5436d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:19:20 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Volume volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 (c40b60a5-de2a-4554-9e54-d9f7ad81e274): created successfully Apr 27 10:19:20 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345884d3-6752-49a2-88ea-717d7b5436d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:19:20 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Flow 'volume_create_manager' (f5ec266e-76dd-434a-b51b-86dbba17307d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:19:20 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-3e524ade-9eea-4b95-bce4-1e27d793ff0d tempest-SnapshotDependencyTests-2118837352 None] Created volume successfully. Apr 27 10:19:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f853aa3e-d52b-4961-9275-89b3c47bc39f tempest-SnapshotDependencyTests-2118837352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:19:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f853aa3e-d52b-4961-9275-89b3c47bc39f tempest-SnapshotDependencyTests-2118837352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:19:21 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-f853aa3e-d52b-4961-9275-89b3c47bc39f tempest-SnapshotDependencyTests-2118837352 None] Creating offline snapshot 9755c275-c87e-4bb9-b353-8d838c90fa50 of volume c40b60a5-de2a-4554-9e54-d9f7ad81e274 {{(pid=81350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 10:19:21 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe92192-a072-4f10-a882-4b0a43a38805]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:19:21 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f853aa3e-d52b-4961-9275-89b3c47bc39f tempest-SnapshotDependencyTests-2118837352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:22 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 Apr 27 10:19:22 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:22 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f853aa3e-d52b-4961-9275-89b3c47bc39f tempest-SnapshotDependencyTests-2118837352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274" returned: 0 in 0.518s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:22 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f853aa3e-d52b-4961-9275-89b3c47bc39f tempest-SnapshotDependencyTests-2118837352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.9755c275-c87e-4bb9-b353-8d838c90fa50 1G {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:22 devstack sudo[91092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.9755c275-c87e-4bb9-b353-8d838c90fa50 1G Apr 27 10:19:22 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:23 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f853aa3e-d52b-4961-9275-89b3c47bc39f tempest-SnapshotDependencyTests-2118837352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.9755c275-c87e-4bb9-b353-8d838c90fa50 1G" returned: 0 in 0.583s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f853aa3e-d52b-4961-9275-89b3c47bc39f tempest-SnapshotDependencyTests-2118837352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.9755c275-c87e-4bb9-b353-8d838c90fa50 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:23 devstack sudo[91097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.9755c275-c87e-4bb9-b353-8d838c90fa50 Apr 27 10:19:23 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:23 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f853aa3e-d52b-4961-9275-89b3c47bc39f tempest-SnapshotDependencyTests-2118837352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 -F qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.9755c275-c87e-4bb9-b353-8d838c90fa50" returned: 0 in 0.465s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:23 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-f853aa3e-d52b-4961-9275-89b3c47bc39f tempest-SnapshotDependencyTests-2118837352 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.9755c275-c87e-4bb9-b353-8d838c90fa50 is being set with open permissions: ugo+rw Apr 27 10:19:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f853aa3e-d52b-4961-9275-89b3c47bc39f tempest-SnapshotDependencyTests-2118837352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.9755c275-c87e-4bb9-b353-8d838c90fa50 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:23 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.9755c275-c87e-4bb9-b353-8d838c90fa50 Apr 27 10:19:23 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:23 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:23 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f853aa3e-d52b-4961-9275-89b3c47bc39f tempest-SnapshotDependencyTests-2118837352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.9755c275-c87e-4bb9-b353-8d838c90fa50" returned: 0 in 0.432s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f853aa3e-d52b-4961-9275-89b3c47bc39f tempest-SnapshotDependencyTests-2118837352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:24 devstack sudo[91105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.info Apr 27 10:19:24 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:24 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f853aa3e-d52b-4961-9275-89b3c47bc39f tempest-SnapshotDependencyTests-2118837352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.info" returned: 0 in 0.463s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:24 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-f853aa3e-d52b-4961-9275-89b3c47bc39f tempest-SnapshotDependencyTests-2118837352 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.info is being set with open permissions: ugo+rw Apr 27 10:19:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f853aa3e-d52b-4961-9275-89b3c47bc39f tempest-SnapshotDependencyTests-2118837352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.info {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:24 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.info Apr 27 10:19:24 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:24 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-f853aa3e-d52b-4961-9275-89b3c47bc39f tempest-SnapshotDependencyTests-2118837352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.info" returned: 0 in 0.448s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:24 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-f853aa3e-d52b-4961-9275-89b3c47bc39f tempest-SnapshotDependencyTests-2118837352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.998s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:19:24 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-f853aa3e-d52b-4961-9275-89b3c47bc39f tempest-SnapshotDependencyTests-2118837352 None] Create snapshot completed successfully Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Flow 'volume_create_manager' (55106875-f273-41d3-a0ee-2a3239de6ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5269a1-47f5-4378-8e96-07704fd130a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5269a1-47f5-4378-8e96-07704fd130a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T08:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e83c16e-3eaa-47d6-aa11-baff6989aeeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f45d07690bd942d08f81b8445cb9abf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T08:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9755c275-c87e-4bb9-b353-8d838c90fa50,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T08:19:26Z,use_quota=True,user_id='d58458967a5748829bb23dd794083d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(febc605f-a017-4522-a03e-8d75411afc2f),volume_type_id=febc605f-a017-4522-a03e-8d75411afc2f)' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2614bd63-b9fd-481a-acea-df7b622db6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2614bd63-b9fd-481a-acea-df7b622db6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d37fdef-5757-4a47-b471-a8e36f9fc16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d37fdef-5757-4a47-b471-a8e36f9fc16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5e83c16e-3eaa-47d6-aa11-baff6989aeeb', 'volume_name': 'volume-5e83c16e-3eaa-47d6-aa11-baff6989aeeb', 'volume_size': 1, 'snapshot_id': '9755c275-c87e-4bb9-b353-8d838c90fa50'}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b44b3ab8-f33f-46d3-822e-34a55d26262f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b44b3ab8-f33f-46d3-822e-34a55d26262f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd3ac7cf-c276-40b3-a774-dacb944eca3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:19:26 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Volume 5e83c16e-3eaa-47d6-aa11-baff6989aeeb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5e83c16e-3eaa-47d6-aa11-baff6989aeeb', 'volume_size': 1, 'snapshot_id': '9755c275-c87e-4bb9-b353-8d838c90fa50'} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Acquiring lock "cinder-quobyte-9755c275-c87e-4bb9-b353-8d838c90fa50-5e83c16e-3eaa-47d6-aa11-baff6989aeeb" by "_create_volume_from_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Lock "cinder-quobyte-9755c275-c87e-4bb9-b353-8d838c90fa50-5e83c16e-3eaa-47d6-aa11-baff6989aeeb" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Creating volume 5e83c16e-3eaa-47d6-aa11-baff6989aeeb from snapshot 9755c275-c87e-4bb9-b353-8d838c90fa50 {{(pid=81350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Selected osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4 as target Quobyte volume. {{(pid=81350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Acquiring lock "cinder-quobyte-5e83c16e-3eaa-47d6-aa11-baff6989aeeb" by "_copy_volume_from_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Lock "cinder-quobyte-5e83c16e-3eaa-47d6-aa11-baff6989aeeb" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] snapshot: 9755c275-c87e-4bb9-b353-8d838c90fa50, volume: 5e83c16e-3eaa-47d6-aa11-baff6989aeeb, {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4ca3e2-d0db-46d7-91cc-bbd11df18aee]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:19:26 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.9755c275-c87e-4bb9-b353-8d838c90fa50 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:26 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.9755c275-c87e-4bb9-b353-8d838c90fa50 Apr 27 10:19:26 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:27 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.9755c275-c87e-4bb9-b353-8d838c90fa50" returned: 0 in 0.510s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:27 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:19:27 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 27 10:19:27 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Creating direct copy from snapshot {{(pid=81350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 27 10:19:27 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d66e7a-40d3-44be-a690-28b105b238fd]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:19:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:27 devstack sudo[91117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 Apr 27 10:19:27 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:27 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274" returned: 0 in 0.525s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:27 devstack cinder-volume[81350]: DEBUG cinder.utils [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Path /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5e83c16e-3eaa-47d6-aa11-baff6989aeeb not found in is_blk_device check {{(pid=81350) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 27 10:19:27 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5e83c16e-3eaa-47d6-aa11-baff6989aeeb {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:27 devstack sudo[91122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5e83c16e-3eaa-47d6-aa11-baff6989aeeb Apr 27 10:19:27 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:31 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5e83c16e-3eaa-47d6-aa11-baff6989aeeb" returned: 0 in 4.263s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:31 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bfb0d8-60b3-47ba-a154-46c6e1dda048]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:19:31 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:32 devstack sudo[91137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 Apr 27 10:19:32 devstack sudo[91137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:32 devstack sudo[91137]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274" returned: 0 in 0.652s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:32 devstack cinder-volume[81350]: DEBUG cinder.image.image_utils [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Image conversion details: src /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274, size 1024.00 MB, duration 4.26 sec, destination /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5e83c16e-3eaa-47d6-aa11-baff6989aeeb {{(pid=81350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 10:19:32 devstack cinder-volume[81350]: INFO cinder.image.image_utils [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Converted 1024.00 MB image at 240.10 MB/s Apr 27 10:19:32 devstack cinder-volume[81350]: WARNING cinder.volume.drivers.remotefs [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5e83c16e-3eaa-47d6-aa11-baff6989aeeb is being set with open permissions: ugo+rw Apr 27 10:19:32 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5e83c16e-3eaa-47d6-aa11-baff6989aeeb {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:32 devstack sudo[91142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5e83c16e-3eaa-47d6-aa11-baff6989aeeb Apr 27 10:19:32 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:33 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5e83c16e-3eaa-47d6-aa11-baff6989aeeb" returned: 0 in 0.431s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:33 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Lock "cinder-quobyte-5e83c16e-3eaa-47d6-aa11-baff6989aeeb" released by "_copy_volume_from_snapshot" :: held 6.467s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:33 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Lock "cinder-quobyte-9755c275-c87e-4bb9-b353-8d838c90fa50-5e83c16e-3eaa-47d6-aa11-baff6989aeeb" released by "_create_volume_from_snapshot" :: held 6.496s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:33 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.513s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:19:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd3ac7cf-c276-40b3-a774-dacb944eca3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e83c16e-3eaa-47d6-aa11-baff6989aeeb', 'volume_size': 1, 'snapshot_id': '9755c275-c87e-4bb9-b353-8d838c90fa50'}' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:19:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3085e3-689b-495e-abf4-6d2291e55558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 10:19:33 devstack cinder-volume[81350]: INFO cinder.volume.flows.manager.create_volume [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Volume volume-5e83c16e-3eaa-47d6-aa11-baff6989aeeb (5e83c16e-3eaa-47d6-aa11-baff6989aeeb): created successfully Apr 27 10:19:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3085e3-689b-495e-abf4-6d2291e55558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81350) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 10:19:33 devstack cinder-volume[81350]: DEBUG cinder.volume.manager [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Flow 'volume_create_manager' (55106875-f273-41d3-a0ee-2a3239de6ea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81350) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 10:19:33 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-2c659ea7-1716-4813-a0c2-03e6f9e36d24 tempest-SnapshotDependencyTests-2118837352 None] Created volume successfully. Apr 27 10:19:34 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7baa5c6e-1e26-4a56-abe2-f2eae83a5832 tempest-SnapshotDependencyTests-2118837352 None] Acquiring lock "cinder-9755c275-c87e-4bb9-b353-8d838c90fa50-delete_snapshot" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:34 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7baa5c6e-1e26-4a56-abe2-f2eae83a5832 tempest-SnapshotDependencyTests-2118837352 None] Lock "cinder-9755c275-c87e-4bb9-b353-8d838c90fa50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:34 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7baa5c6e-1e26-4a56-abe2-f2eae83a5832 tempest-SnapshotDependencyTests-2118837352 None] Acquiring lock "cinder-quobyte-c40b60a5-de2a-4554-9e54-d9f7ad81e274" by "delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:34 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7baa5c6e-1e26-4a56-abe2-f2eae83a5832 tempest-SnapshotDependencyTests-2118837352 None] Lock "cinder-quobyte-c40b60a5-de2a-4554-9e54-d9f7ad81e274" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:34 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7baa5c6e-1e26-4a56-abe2-f2eae83a5832 tempest-SnapshotDependencyTests-2118837352 None] Acquiring lock "cinder-quobyte-9755c275-c87e-4bb9-b353-8d838c90fa50" by "_delete_snapshot" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:34 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7baa5c6e-1e26-4a56-abe2-f2eae83a5832 tempest-SnapshotDependencyTests-2118837352 None] Lock "cinder-quobyte-9755c275-c87e-4bb9-b353-8d838c90fa50" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-7baa5c6e-1e26-4a56-abe2-f2eae83a5832 tempest-SnapshotDependencyTests-2118837352 None] Deleting offline snapshot 9755c275-c87e-4bb9-b353-8d838c90fa50 of volume c40b60a5-de2a-4554-9e54-d9f7ad81e274 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 10:19:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-7baa5c6e-1e26-4a56-abe2-f2eae83a5832 tempest-SnapshotDependencyTests-2118837352 None] snapshot_file for this snap is: volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.9755c275-c87e-4bb9-b353-8d838c90fa50 {{(pid=81350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 10:19:34 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[21317825-d1ab-4da5-b30d-99b16821220d]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:19:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7baa5c6e-1e26-4a56-abe2-f2eae83a5832 tempest-SnapshotDependencyTests-2118837352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.9755c275-c87e-4bb9-b353-8d838c90fa50 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:34 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.9755c275-c87e-4bb9-b353-8d838c90fa50 Apr 27 10:19:34 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:34 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7baa5c6e-1e26-4a56-abe2-f2eae83a5832 tempest-SnapshotDependencyTests-2118837352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.9755c275-c87e-4bb9-b353-8d838c90fa50" returned: 0 in 0.492s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:34 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.remotefs [None req-7baa5c6e-1e26-4a56-abe2-f2eae83a5832 tempest-SnapshotDependencyTests-2118837352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 10:19:34 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a59122f-cce8-4d6b-a0c0-58427d6132c3]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:19:34 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7baa5c6e-1e26-4a56-abe2-f2eae83a5832 tempest-SnapshotDependencyTests-2118837352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:34 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 Apr 27 10:19:34 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:35 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7baa5c6e-1e26-4a56-abe2-f2eae83a5832 tempest-SnapshotDependencyTests-2118837352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274" returned: 0 in 0.512s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7baa5c6e-1e26-4a56-abe2-f2eae83a5832 tempest-SnapshotDependencyTests-2118837352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.9755c275-c87e-4bb9-b353-8d838c90fa50 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:35 devstack sudo[91156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.9755c275-c87e-4bb9-b353-8d838c90fa50 Apr 27 10:19:35 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:35 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7baa5c6e-1e26-4a56-abe2-f2eae83a5832 tempest-SnapshotDependencyTests-2118837352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.9755c275-c87e-4bb9-b353-8d838c90fa50" returned: 0 in 0.523s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:35 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7baa5c6e-1e26-4a56-abe2-f2eae83a5832 tempest-SnapshotDependencyTests-2118837352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.9755c275-c87e-4bb9-b353-8d838c90fa50 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:35 devstack sudo[91161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.9755c275-c87e-4bb9-b353-8d838c90fa50 Apr 27 10:19:35 devstack sudo[91161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:36 devstack sudo[91161]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:36 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-7baa5c6e-1e26-4a56-abe2-f2eae83a5832 tempest-SnapshotDependencyTests-2118837352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274.9755c275-c87e-4bb9-b353-8d838c90fa50" returned: 0 in 0.427s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7baa5c6e-1e26-4a56-abe2-f2eae83a5832 tempest-SnapshotDependencyTests-2118837352 None] Lock "cinder-quobyte-9755c275-c87e-4bb9-b353-8d838c90fa50" released by "_delete_snapshot" :: held 2.060s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7baa5c6e-1e26-4a56-abe2-f2eae83a5832 tempest-SnapshotDependencyTests-2118837352 None] Lock "cinder-quobyte-c40b60a5-de2a-4554-9e54-d9f7ad81e274" released by "delete_snapshot" :: held 2.082s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:36 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-7baa5c6e-1e26-4a56-abe2-f2eae83a5832 tempest-SnapshotDependencyTests-2118837352 None] Created reservations ['5900ed52-815e-45bc-a037-fa371aa5f06e', '52989c5d-53ec-414c-8b6c-27bb37a24b52', 'fc17e3f3-5fe8-474b-a659-00edee397fab', 'a5633694-e508-4ae4-a4cc-e8f08decf1d0'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:19:36 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-7baa5c6e-1e26-4a56-abe2-f2eae83a5832 tempest-SnapshotDependencyTests-2118837352 None] Delete snapshot completed successfully. Apr 27 10:19:36 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-7baa5c6e-1e26-4a56-abe2-f2eae83a5832 tempest-SnapshotDependencyTests-2118837352 None] Lock "cinder-9755c275-c87e-4bb9-b353-8d838c90fa50-delete_snapshot" released by "delete_snapshot" :: held 2.216s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-23ff4ce8-9a0f-42a8-a31b-9cccfac6ac27 tempest-SnapshotDependencyTests-2118837352 None] Acquiring lock "cinder-c40b60a5-de2a-4554-9e54-d9f7ad81e274-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-23ff4ce8-9a0f-42a8-a31b-9cccfac6ac27 tempest-SnapshotDependencyTests-2118837352 None] Lock "cinder-c40b60a5-de2a-4554-9e54-d9f7ad81e274-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-23ff4ce8-9a0f-42a8-a31b-9cccfac6ac27 tempest-SnapshotDependencyTests-2118837352 None] Acquiring lock "cinder-quobyte-c40b60a5-de2a-4554-9e54-d9f7ad81e274" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:37 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-23ff4ce8-9a0f-42a8-a31b-9cccfac6ac27 tempest-SnapshotDependencyTests-2118837352 None] Lock "cinder-quobyte-c40b60a5-de2a-4554-9e54-d9f7ad81e274" acquired by "delete_volume" :: waited 0.015s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:37 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c7166e-dd54-4219-b032-7433903bc964]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:19:37 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-23ff4ce8-9a0f-42a8-a31b-9cccfac6ac27 tempest-SnapshotDependencyTests-2118837352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:37 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 Apr 27 10:19:37 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:38 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-23ff4ce8-9a0f-42a8-a31b-9cccfac6ac27 tempest-SnapshotDependencyTests-2118837352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274" returned: 0 in 0.513s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-23ff4ce8-9a0f-42a8-a31b-9cccfac6ac27 tempest-SnapshotDependencyTests-2118837352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:38 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274 Apr 27 10:19:38 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:38 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-23ff4ce8-9a0f-42a8-a31b-9cccfac6ac27 tempest-SnapshotDependencyTests-2118837352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-c40b60a5-de2a-4554-9e54-d9f7ad81e274" returned: 0 in 0.429s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:38 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-23ff4ce8-9a0f-42a8-a31b-9cccfac6ac27 tempest-SnapshotDependencyTests-2118837352 None] Lock "cinder-quobyte-c40b60a5-de2a-4554-9e54-d9f7ad81e274" released by "delete_volume" :: held 1.002s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:38 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-23ff4ce8-9a0f-42a8-a31b-9cccfac6ac27 tempest-SnapshotDependencyTests-2118837352 None] Created reservations ['53971004-30f0-4185-b7c1-5049f54dbf0d', '4c7b6ece-fa64-47a6-8b3d-8742e2f35f5d', '18334bd0-c455-410c-9c27-ac0f1cdbab07', '6506bbe0-5213-49d4-a05e-22889d68937d'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:19:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-23ff4ce8-9a0f-42a8-a31b-9cccfac6ac27 tempest-SnapshotDependencyTests-2118837352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:19:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-23ff4ce8-9a0f-42a8-a31b-9cccfac6ac27 tempest-SnapshotDependencyTests-2118837352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:19:38 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-23ff4ce8-9a0f-42a8-a31b-9cccfac6ac27 tempest-SnapshotDependencyTests-2118837352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:19:38 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-23ff4ce8-9a0f-42a8-a31b-9cccfac6ac27 tempest-SnapshotDependencyTests-2118837352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:19:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-23ff4ce8-9a0f-42a8-a31b-9cccfac6ac27 tempest-SnapshotDependencyTests-2118837352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:19:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-23ff4ce8-9a0f-42a8-a31b-9cccfac6ac27 tempest-SnapshotDependencyTests-2118837352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:38 devstack sudo[91172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:19:38 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:38 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:38 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-23ff4ce8-9a0f-42a8-a31b-9cccfac6ac27 tempest-SnapshotDependencyTests-2118837352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.422s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:38 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-23ff4ce8-9a0f-42a8-a31b-9cccfac6ac27 tempest-SnapshotDependencyTests-2118837352 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:19:39 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-23ff4ce8-9a0f-42a8-a31b-9cccfac6ac27 tempest-SnapshotDependencyTests-2118837352 None] Deleted volume successfully. Apr 27 10:19:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-23ff4ce8-9a0f-42a8-a31b-9cccfac6ac27 tempest-SnapshotDependencyTests-2118837352 None] Lock "cinder-c40b60a5-de2a-4554-9e54-d9f7ad81e274-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e844c4a0-f013-47f7-a98a-6600b8e972d9 tempest-SnapshotDependencyTests-2118837352 None] Acquiring lock "cinder-5e83c16e-3eaa-47d6-aa11-baff6989aeeb-delete_volume" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e844c4a0-f013-47f7-a98a-6600b8e972d9 tempest-SnapshotDependencyTests-2118837352 None] Lock "cinder-5e83c16e-3eaa-47d6-aa11-baff6989aeeb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e844c4a0-f013-47f7-a98a-6600b8e972d9 tempest-SnapshotDependencyTests-2118837352 None] Acquiring lock "cinder-quobyte-5e83c16e-3eaa-47d6-aa11-baff6989aeeb" by "delete_volume" {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 10:19:39 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e844c4a0-f013-47f7-a98a-6600b8e972d9 tempest-SnapshotDependencyTests-2118837352 None] Lock "cinder-quobyte-5e83c16e-3eaa-47d6-aa11-baff6989aeeb" acquired by "delete_volume" :: waited 0.018s {{(pid=81350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 10:19:39 devstack cinder-volume[81350]: DEBUG oslo.privsep.daemon [-] privsep: reply[833ec6ef-cb29-4d2b-9bb7-8fdcd939092c]: (4, 'qcow2') {{(pid=82279) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 10:19:39 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e844c4a0-f013-47f7-a98a-6600b8e972d9 tempest-SnapshotDependencyTests-2118837352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5e83c16e-3eaa-47d6-aa11-baff6989aeeb {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:39 devstack sudo[91175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5e83c16e-3eaa-47d6-aa11-baff6989aeeb Apr 27 10:19:39 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:40 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e844c4a0-f013-47f7-a98a-6600b8e972d9 tempest-SnapshotDependencyTests-2118837352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5e83c16e-3eaa-47d6-aa11-baff6989aeeb" returned: 0 in 0.502s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e844c4a0-f013-47f7-a98a-6600b8e972d9 tempest-SnapshotDependencyTests-2118837352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5e83c16e-3eaa-47d6-aa11-baff6989aeeb {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:40 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5e83c16e-3eaa-47d6-aa11-baff6989aeeb Apr 27 10:19:40 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:40 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e844c4a0-f013-47f7-a98a-6600b8e972d9 tempest-SnapshotDependencyTests-2118837352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c/volume-5e83c16e-3eaa-47d6-aa11-baff6989aeeb" returned: 0 in 0.439s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:40 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e844c4a0-f013-47f7-a98a-6600b8e972d9 tempest-SnapshotDependencyTests-2118837352 None] Lock "cinder-quobyte-5e83c16e-3eaa-47d6-aa11-baff6989aeeb" released by "delete_volume" :: held 0.987s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:40 devstack cinder-volume[81350]: DEBUG cinder.quota [None req-e844c4a0-f013-47f7-a98a-6600b8e972d9 tempest-SnapshotDependencyTests-2118837352 None] Created reservations ['b0b1eba4-d559-4b5d-b85e-cc1b7037cfaa', 'e5e51e2d-e074-43c3-8752-5280dcddae56', 'd1fb199d-874d-4428-9816-4724a9eabb8b', 'b0b716dc-3e50-46ba-860f-db0d3eea7d84'] {{(pid=81350) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 10:19:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e844c4a0-f013-47f7-a98a-6600b8e972d9 tempest-SnapshotDependencyTests-2118837352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 10:19:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e844c4a0-f013-47f7-a98a-6600b8e972d9 tempest-SnapshotDependencyTests-2118837352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 10:19:40 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e844c4a0-f013-47f7-a98a-6600b8e972d9 tempest-SnapshotDependencyTests-2118837352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4': None} {{(pid=81350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 10:19:40 devstack cinder-volume[81350]: DEBUG cinder.volume.drivers.quobyte [None req-e844c4a0-f013-47f7-a98a-6600b8e972d9 tempest-SnapshotDependencyTests-2118837352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-03ac2fa0-723e-494d-aa71-5920eef41bc4'] {{(pid=81350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 10:19:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.lockutils [None req-e844c4a0-f013-47f7-a98a-6600b8e972d9 tempest-SnapshotDependencyTests-2118837352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81350) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 10:19:40 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e844c4a0-f013-47f7-a98a-6600b8e972d9 tempest-SnapshotDependencyTests-2118837352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 10:19:40 devstack sudo[91183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c Apr 27 10:19:40 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 10:19:41 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root Apr 27 10:19:41 devstack cinder-volume[81350]: DEBUG oslo_concurrency.processutils [None req-e844c4a0-f013-47f7-a98a-6600b8e972d9 tempest-SnapshotDependencyTests-2118837352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46d1430f5ca3d2271c6b4894fc68694c" returned: 0 in 0.425s {{(pid=81350) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 10:19:41 devstack cinder-volume[81350]: DEBUG cinder.manager [None req-e844c4a0-f013-47f7-a98a-6600b8e972d9 tempest-SnapshotDependencyTests-2118837352 None] Notifying Schedulers of capabilities ... {{(pid=81350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 10:19:41 devstack cinder-volume[81350]: INFO cinder.volume.manager [None req-e844c4a0-f013-47f7-a98a-6600b8e972d9 tempest-SnapshotDependencyTests-2118837352 None] Deleted volume successfully. Apr 27 10:19:41 devstack cinder-volume[81350]: DEBUG cinder.coordination [None req-e844c4a0-f013-47f7-a98a-6600b8e972d9 tempest-SnapshotDependencyTests-2118837352 None] Lock "cinder-5e83c16e-3eaa-47d6-aa11-baff6989aeeb-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=81350) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 10:19:50 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:SELECT=54,cinder:INSERT=21,cinder:UPDATE=80,cinder:DELETE=7 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 10:19:51 devstack cinder-volume[81350]: DEBUG dbcounter [-] [81350] Writing DB stats cinder:UPDATE=78,cinder:DELETE=5,cinder:SELECT=52,cinder:INSERT=18 {{(pid=81350) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}